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Preface 


This  report  represents  the  work  of  a committee  formed  by  the  National  Institute  on  Drug 
Abuse  to  provide  a Technical  Review  on  the  Consequences  of  Adolescent  Drug  Use.  The  committee ^ 
whose  merribers  included  Richard  R.  Clayton,  Marvin  D.  Dunnette,  Herbert  Hendin,  George  J.  Huba, 
Lloyd  D.  Johnston,  Reese  T.  Jones,  Denise  B.  Kandel,  Howard  B.  Kaplan,  Karolyn  Siegal,  and 
Gene  M.  Smith,  met  several  times  in  1979  under  the  sponsorship  of  NIDA  as  well  as  the  UCLA 
Research  Center  on  Adolescent  Drug  Use.  Dr.  Dan  Lettieri  coordinated  the  NIDA  activities. 

The  charge  to  the  committee  was  to  review  available  questionnaire  research  instruments  useful 
in  determining  the  major  consequences  of  adolescent  drug  use,  to  provide  an  evaluation  of  the 
relevance  of  various  domains  of  variables  for  understanding  drug  use  consequences,  and  to  make 
recommendations  for  the  utilization  of  core  sets  of  items  in  future  questionnaire  research  on 

effects. 

The  committee  concluded  that  research  on  consequences  of  adolescent  drug  use,  especially 
marijuana  use,  required  the  assessment  not  only  of  drug  usage  patterns  and  various  specified 
drug  use  consequences , but  also  a variety  of  historical  and  concurrent  contextual  variables 
that  would  serve  to  provide  scientific  meaning  to  any  possible  observed  effects.  The  domains 
of  variables  considered  important  include:  drug  use  behaviors,  psychosocial  aspects  of  drug 

use,  psychological  health,  marijuana  reactions,  accidents  and  hospitalization,  socioeconomic 
status  and  economics,  deviance,  long-term  drug  effects,  physical  health,  short-term  drug  effects, 
interpersonal  relations,  life  satisfaction,  and  the  use  of  leisure  time.  The  committee  con- 
cluded that  no  existing  instrument  served  to  adequately  assess  the  relevant  variables  from  these 
various  domains.  Consequently,  the  committee  generated  the  instrument  reproduced  in  chapter  1 
of  this  report. 

The  number  of  meetings  available  to  the  committee  were  too  few  to  yield  a consensus  ques- 
tionnaire that  could  be  recommended  for  use  by  the  drug  abuse  research  community.  Consequently , 
the  UCLA  Research  Center  undertook  the  task  of  providing  evidence  on  the  content  and  construct 
validity  of  the  items  generated  by  the  committee,  using  drug  researcher  expertise  as  the  basis 
for  evaluation.  Chapter  2 of  this  report  provides  a systematic  presentation  and  analysis  of 
the  views  of  drug  researchers  on  the  items  listed  in  chapter  1.  The  drug  researchers  providing 
the  evaluation  were  the  members  of  the  original  committee  that  had  generated  the  items  in 
chapter  1,  plus  another  group  of  experts  on  drug  research.  Chapter  2 also  provides  systematic 
information  that  can  be  used  by  prospective  researchers  to  select  research  materials  for  proj- 
ects aimed  at  understanding  the  consequences  of  aolescent  drug  use,  especially  marijuana  use. 

The  information  given  in  chapter  2 provided  the  building  blocks  needed  by  the  National 
Institute  on  Drug  Abuse  for  making  some  specific  recommendations  for  future  research  instru- 
mentation. These  recommendations  are  included  as  chapters  3 and  4 of  this  report. 

Readers  will  have  different  purposes  for  using  this  volume.  In  general  however  there  will 
be  two  distinct  purposes:  (1)  as  a general  guide  to  developing  one's  own  set  of  questions  aimed 

at  tapping  the  potential  consequences  of  marijuana  use,  or  (2)  as  a source  book  for  finding  a 
brief  set  of  items  that  can  be  added  to  a study  focusing  on  marijuana  consequences . Chapter  1 
lists  a large  selection  of  items  classed  according  to  various  content  categories  which  interested 
users  can  persue  in  deciding  which,  and  how  many  items  could  be  included  in  their  own  projects . 
Chapter  4 attempts  to  cull  a selective  and  short  listing  of  those  items  which,  in  general,  our 
panel  of  experts  rated  as  highly  relevant  to  most  inquiries  on  marijuana  consequences . The 
short  form  of  the  questionnaire  presented  in  chapter  4 can  be  duplicated,  as  is,  and  administered 
directly. 

The  editors  wish  to  acknowledge  the  contributions  of  many  individuals  for  their  assistance 
on  this  volume.  Arthur  L.  Falisoc  and  Richard  J.  Stone  assisted  in  conducting  the  analyses  of 
chapter  2.  Julie  Honig,  Suong  Ngoc  Luong,  and  Elizabeth  Shelby  assisted  in  questionnaire  format 
conversions.  Marilyn  Alkin  coordinated  the  Los  Angeles  meeting.  We  especially  wish  to  acknowl- 
edge the  individuals  who  contributed  the  items  of  chapter  1 and  provided  the  ratings  of  chapter  2. 
Preparation  of  this  volume  and  the  work  described  within  was  partially  supported  by  Grant  Number 
DA  01070  from  the  National  Institute  on  Drug  Abuse. 

Peter  M.  Rentier,  Ph.D. 

Chairman,  Technical  Review  Cormittee 
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Chapter  1 

QUESTIONNAIRE  ITEMS 

CONSULTANTS 

Peter  M.  Bentler,  Ph.D. 
Richard  R.  Clayton,  Ph.D 
Marvin  D.  Dunnette,  Ph.D 
Herbert  Hendin,  M.D. 
George  J.  Huba,  Ph.D. 
Lloyd  D.  Johnston,  Ph.D. 

Reese  T.  Jones,  M.D. 
Denise  B.  Kandel,  Ph.D. 
Howard  B.  Kaplan,  Ph.D. 
Karolynn  Siegel,  Ph.D. 
Gene  M.  Smith,  Ph.D. 
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ACCIDENTS  AND  HOSPITALIZATION 


How  many  times  have  the  following  things  happened  to  you  in  the  last  12  months? 
Circle  one  answer  for  each  question.  Use  this  scale: 


None  One  Two  Three  Four  Five  Six  or  more 


How 

many  times  in  the  last  12  months  have  you 

1 . 

Had  an  accident  while  driving  a car 

0 

1 

2 

3 

4 

5 

6+ 

2. 

Spent  a night  in  the  hospital 

0 

1 

2 

3 

4 

5 

6+ 

3. 

Had  to  see  a doctor  for  a health 
emergency 

0 

1 

2 

3 

4 

5 

6+ 

4. 

Had  to  see  a doctor  for  illness 

0 

1 

2 

3 

4 

5 

6+ 

5. 

Gone  to  a dentist  for  a checkup 

0 

1 

2 

3 

4 

5 

6+ 

6. 

Gone  to  a dentist  to  get  a tooth  fixed 

0 

1 

2 

3 

4 

5 

6+ 

7. 

Felt  really  sick 

0 

1 

2 

3 

4 

5 

6+ 

8. 

Had  an  accident  after  drinking  alcohol 

0 

1 

2 

3 

4 

5 

6+ 

9. 

Had  an  accident  after  smoking  marijuana 

0 

1 

2 

3 

4 

5 

6+ 

10. 

Had  an  accident  after  getting  high 
on  some  other  drug 

0 

1 

2 

3 

4 

5 

6+ 

11 . 

Had  an  accident  because  you  were  drunk 
or  drinking  alcohol 

0 

1 

2 

3 

4 

5 

6+ 

12. 

Had  an  accident  because  you  were 
stoned  on  marijuana 

0 

1 

2 

3 

4 

5 

6+ 

13. 

Had  an  accident  because  you  were  high 
on  some  other  drug 

0 

1 

2 

3 

4 

5 

6+ 
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LEISURE  TIME 


14.  During  a typical  week,  how  many  evenings  do  you  go  out  for  fun  and  re- 
creation? (Circle  one  answer.) 

1 . less  than  one 

2.  one 

3 . two 

4.  three 

5.  four  or  five 

6.  six  or  seven 


15.  On  the  average,  how  often  do  you  go  out  with  a date  (or  your  spouse,  if 
you  are  married)?  (Circle  one  answer.) 

1 . never 

2.  once  a month  or  less 

3.  two  or  three  times  a month 

4.  once  a week 

5.  two  or  three  times  a week 

6.  over  three  times  a week 


In  the  following  list  you  will  find  some  statements  about  leisure  time.  Please 
show  whether  you  agree  or  disagree  with  each  statement.  (Circle  one  number 
for  each  item.) 


Disagree  Mostly  Neither  Mostly  Agree 
Disagree  Agree 


16.  I find  that  I don't  know 

what  to  do  with  a lot  1 

of  my  leisure  time 

17.  Time  seems  to  pass  very 

quickly  during  my  1 

leisure  hours 

18.  I feel  that  I waste  a lot 

of  my  free  time  because  I 
don't  end  up  doing  1 

things  that  are  either 
productive  or  enjoyable 

19.  I usually  have  enough  1 

time  for  the  things  I 

want  to  do 

20.  I feel  like  I never  get  1 

to  really  relax 
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How  often  do  you  do  the  following?  Circle  one  number  for  each. 


A few 

Once  or 

At  least 

Almost 

Never 

times  a 

twice 

once  a 

every 

year 

a month 

week 

day 

How  often  do  you: 

21 . 

Watch  TV 

1 

22. 

Ride  around  in  a car 
(or  motorcycle)  just 
for  fun 

1 

23. 

Participate  in  team  sports 

1 

24. 

Go  jogging  or  exercise 
by  yourself 

1 

25. 

Work  around  the  house, 
yard,  garden,  car,  etc. 

1 

26. 

Get  together  with  friends 
informally 

1 

27. 

Spend  at  least  an  hour  of 
leisure  time  alone 

1 

28. 

Read  books,  magazines, 
or  newspapers 

1 

29. 

Go  to  taverns,  bars,  or 
nightclubs 

1 

30. 

Go  to  parties  or  other 
social  affairs 

1 

2  3 4 5 
2 3 4 5 
2 3 4 5 


2 3 


4 5 


2 3 4 5 

2 3 4 5 


2 


3 4 5 


2 3 


4 5 


2 3 4 5 


2 3 


4 5 


31.  On  the  average  during  the  last  6 months,  about  how  many  hours  per  day  did 
you  watch  television? 

hours  per  day 
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DEVIANCE 


During  the  last  12  months  how  often  have  you  done  the  following  things?  Circle 
one  answer  for  each  item. 

None  One  Two  Three  Five 

or  four  or  more 


During  the  last  12  months,  how  often  have  you: 


32.  Argued  or  had  a fight  with  either 

of  your  parents  1 2 

33.  Gotten  into  a serious  fight  in 

school  or  at  work  1 2 

34.  Taken  part  in  a fight  where  a 

group  of  your  friends  were  1 2 

against  another  group 

35.  Hurt  someone  badly  enough 

to  need  bandages  or  a doctor  1 2 

36.  Taken  something  not  belonging 

to  you  worth  under  $50  1 2 

37.  Taken  something  not  belonging 

to  you  worth  over  $50  1 2 

38.  Taken  something  from  a store 

without  paying  for  it  1 2 

39.  Taken  a car  without  permission 

of  the  owner  1 2 

40.  Set  fire  to  someone's  property 

on  purpose  1 2 

41.  Damaged  property  at  work  or 

at  school  on  purpose  1 2 

42.  Gotten  into  trouble  with  police 

because  of  something  you  did  1 2 

43.  Broken  into  a house  or  school  or 

place  of  business  1 2 

44.  Been  armed  or  used  a weapon  of 

any  kind  while  committing  a theft  1 2 

or  robbery 


3 

3 

3 


3 

3 

3 

3 

3 

3 

3 

3 

3 

3 


4 5 

4 5 

4 5 


4 5 

4 5 

4 5 

4 5 


4 5 

4 5 


4 5 


4 5 

4 5 


4 5 


5 


None 


One 


T wo 


Three  Five 
or  four  or  more 


45. 

Stolen  anything  from  a person 
face  to  face 

1 

2 

3 

4 

5 

46. 

Had  a job  which  involved  illegal 
gambling 

1 

2 

3 

4 

5 

47. 

Forged  or  passed  bad  checks 

1 

2 

3 

4 

5 

48. 

Forged  prescriptions  or  passed 
script 

1 

2 

3 

4 

5 

49. 

Sold  marijuana 

1 

2 

3 

4 

5 

50. 

Sold  other  drugs,  like  heroin 
or  cocaine 

1 

2 

3 

4 

5 
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ADVERSE  REACTIONS  TO  MARIJUANA 


How  often  have  the  following  things  happened  to  you  as  a result  of  using  mari- 
juana in  the  past  year?  Circle  one  number  for  each  item  below. 


Never 

Only  Once 

momentarily 

2-3 

times 

4-10 

times 

more 

than 

51 . 

1 was  worried  because  1 didn't 
know  how  people  were  reacting 

0 

1 

2 

3 

4 

5 

52. 

to  me 

1 felt  as  if  1 were  being 
persecuted 

0 

1 

2 

3 

4 

5 

53. 

1 felt  everyone  was  making 
fun  of  me  and  laughing  at  me 

0 

1 

2 

3 

4 

5 

54. 

1 felt  panicky  because  of 
changes  in  my  sense  of  time 

0 

1 

2 

3 

4 

5 

55. 

1 was  afraid  of  losing  control 

0 

1 

2 

3 

4 

5 

56. 

The  same  unpleasant  things  kept 
happening  over  and  over,  and 

0 

1 

2 

3 

4 

5 

57. 

there  was  nothing  1 could  do 
about  it. 

1 saw  myself  as  1 really  am 
and  didn't  like  what  1 saw 

0 

1 

2 

3 

4 

5 

58. 

1 had  frightening  or  terrifying 
hallucinations 

0 

1 

2 

3 

4 

5 

59. 

1 was  afraid  1 was  going  to  die 

0 

1 

2 

3 

4 

5 

60. 

1 felt  on  the  fringes  of  sheer 
horror 

0 

1 

2 

3 

4 

5 
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PHYSICAL  HEALTH 


Indicate  whether  the  following  things  have  happened  to  you  in  the  last  30  days. 
Circle  one  number  for  each  answer. 


Not  at  all  Some  A lot 


In  the  last  30  days,  have  you: 


61 . Had  any  trouble  with  your  eyes  (for 
example,  itching,  watering,  blurry  vision, 

seeing  double)  1 

62.  Had  any  problems  with  your  teeth,  mouth, 

or  gums  1 

63.  Had  headaches  more  than  once  a week  (head- 

aches that  interfere  with  your  work  or  with 
school  or  ordinary  daily  activities)  1 

64.  Had  trouble  with  sinus  congestion,  running 

nose,  sneezing  spells  1 

65.  Had  a sore  throat  or  hoarse  voice  1 

Had  any  trouble  with  your  lungs  or  breathing, 
for  example: 

66.  Wheezes  or  gasps  1 

67.  Coughing  spells  1 

68.  Been  coughing  up  phlegm,  blood  1 

69.  Chest  colds  more  than  once  a month  1 

70.  Had  any  trouble  with  your  heart  such  as 

racing,  beating,  hard  chest  pains  1 

71 . Had  shortness  of  breath  when  you  were  not 

exercising  or  breathing  hard  1 

72.  Had  dizzy  spells  1 

73.  Been  troubled  by  heartburn  or  other 

stomach  pain  1 

74.  Had  constipation  and/or  loose  bowels  1 

75.  Had  any  urinary  problems  (going  to  the 

bathroom)  such  as  difficulty  in  starting  1 

urine,  burning  feeling,  or  excessive 

frequency 


76.  Had  trouble  with  stiff  or  painful  or  swollen 

joints  or  muscles  1 


2 

2 


2 

2 

2 


2 

2 

2 

2 

2 

2 

2 

2 

2 

2 


2 


3 

3 


3 

3 

3 


3 

3 

3 

3 

3 

3 

3 

3 

3 

3 


3 
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Not  at  all 


Some 


A lot 


77. 

Had  any  skin  problems  (other  than 
acne)  such  as  itching  or  rashes 

1 

2 

3 

78. 

Felt  faint  or  passed  out 

1 

2 

3 

79. 

Had  fits  (seizures)  or  convulsions 

1 

2 

3 

80. 

Did  your  arms  or  legs  have  a tendency  to 
shake  or  tremble 

1 

2 

3 

81 . 

Did  you  have  difficulty  in  thinking,  con- 
centrating, or  with  your  memory 

1 

2 

3 

82. 

Did  you  have  unusual  trouble 
falling  asleep  at  night 

1 

2 

3 

FOR  WOMEN  ONLY 

83. 

Have  you  had  menstrual  problems  such  as 
irregular  periods,  bleeding  between  periods 

1 

2 

3 

84. 

Are  you  taking  or  have  you  ever  taken 
birth  control  pills 

1 YES 

2 NO 

85. 

How  many  of  the  following  have  you  had? 
pregnancies 

86. 

miscarriages 

87. 

stillbirths 

88. 

premature  births 

89. 

induced  abortions 

90. 

91 . 

92. 

93. 

94. 

When  was  the  last  time  you  had 

Pregnancy 

Miscarriage 

Stillbirth 

Premature  birth 

Induced  abortion 

FOR  MEN  AND  WOMEN 

95.  Have  you  ever  had  V.D.?  (Check  One) 

Never 

Once  or  twice 

Three  to  five  times 

More  than  five  times 

Compared  with  last  year,  have  you  had  any  of  the  following  in  the 
last  30  days: 


96. 

Weight  changes  ( increase; 

decrease) 

97. 

Feeling  unusually  hot  and  cold 

98. 

Decreased  appetite 

99. 

Increased  appetite 
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Indicate  if  the  following  statements  are  true  or  false  for  you. 


100. 
101 . 

102. 

103. 

104. 

105. 

106. 

107. 


Definitely  Mostly  Don't  Mostly  Definitely 
false  false  know  true  true 


I seem  to  get  sick  a 
little  easier  than  other 

people  1 2 3 4 5 

Most  people  get  sick 
a little  easier  than  I 

do  1 2 3 4 5 


I am  somewhat  ill 


2 3 


4 5 


I'm  not  as  healthy  now 

as  I used  to  be  1 2345 


My  body  seems  to 

resist  illness  very  well  1 2 3 4 5 


My  health  is  excellent  1 2 

When  there  is  something 
going  around,  I usually 

catch  it  12 


3 4 5 


3 4 5 


Were  there  any  days  during  the  past  30  days  when  you  stayed  in 
bed  most  or  ^ of  the  day  because  you  weren't  feeling  well? 

Yes  No 

A.  About  how  many  days  did  that  happen?  

(No.  of  days) 
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DRUGS,  CIGARETTES,  AND  HARD  LIQUOR 


108.  About  how  many  times  altogether  (if  any)  have  you  ever  used  marijuana 
or  hashish?  Circle  one  answer. 

1 Never  used  If  you  circled  "Never  used,"  Go  to  question  162. 

2 1-9  times  If  you  circled  "1-9  times,"  Go  to  question  162. 

3 10-39  times 

4 40-59  times 

5 60-99  times 

6 100-999  times 

7 1,000  times  or  more 

109.  How  old  were  you  when  you  first  tried  marijuana  or  hashish? 

(Indicate  age.)  years  old 


110.  When  was  the  most  recent  time  you  used  marijuana  or  hashish?  Circle 
one  answer. 

1 Today 

2 Yesterday 

3 Three  to  7 days  ago 

4 Two  to  4 weeks  ago 

5 One  to  12  months  ago 

6 More  than  12  months  ago 

If  you  circled  "more  than  12  months  ago,"  go  to  question  162. 

111.  How  often  did  you  use  marijuana  or  hashish  during  the  PAST  12 
MONTHS?  Circle  one  answer. 

1 Once  or  twice  during  the  year 

2 Three  to  eleven  times  during  the  year 

3 Once  a month 

4 Two  or  three  times  a month 

5 Once  a week 

6 Two  or  three  times  a week 

7 Four  to  six  times  a week 

8 Every  day 

112.  How  often  (if  at  all)  have  you  used  marijuana  or  hashish  during 
the  last  30  days?  Circle  one  answer. 

1 None 

2 Once  a month 

3 Two  or  three  times  a month 

4 Once  a week 

5 Two  or  three  days  a week 

6 Four  to  six  days  a week 

7 Every  day 
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113.  During  the  LAST  30  DAYS  about  how  many  marijuana  cigarettes  (joints, 
reefers),  or  the  equivalent,  did  you  smoke  a day,  on  the  average?  (If  you 
shared  them  with  other  people,  count  only  the  amount  YOU  smoked.)  Circle 
one  answer. 

1 None 

2 Less  than  one  a day 

3 One  a day 

4 Two  to  three  a day 

5 Four  to  six  a day 

6 Seven  or  more  a day 

114.  Do  you  know  how  much  marijuana  you  have  used  (in  ounces)  during  the 
LAST  30  DAYS?  Circle  one  answer. 

8 Don't  know 

1 None 

2 Less  than  \ ounce 

3 About  \ ounce 

4 About  1 ounce 

5 About  2 ounces 

6 Three  to  5 ounces 

7 Six  or  more  ounces 

115.  When  you  use  marijuana  or  hashish  how  high  do  you  usually  get?  Circle  one 

answer. 

1 Not  at  all  high 

2 A little  high 

3 Moderately  high 

4 Very  high 

5 Do  not  now  use  marijuana 

116.  When  you  use  marijuana  or  hashish  how  long  do  you  usually  stay  high? 

Circle  one  answer. 

1 Usually  don't  get  high 

2 One  to  two  hours 

3 Three  to  6 hours 

4 Seven  to  24  hours 

5 More  than  24  hours 

6 Do  not  now  use  marijuana 
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When  you  used  marijuana  or  hashish  during  the  last  year,  how  often  did  you  use  it 
in  each  of  the  following  situations?  (Circle  one  answer  for  each.) 


Not 

A few 

Some 

Most 

Every 

at 

of  the 

of  the 

of  the 

time 

all 

times 

time 

time 

117. 

At  your  own  home, 
dormitory 

apartment,  or  1 

2 

3 

4 

5 

118. 

At  work 

1 

2 

3 

4 

5 

119. 

At  school 

1 

2 

3 

4 

5 

120. 

At  a friend's  home 

1 

2 

3 

4 

5 

121 . 

At  parents'  home 

1 

2 

3 

4 

5 

122. 

At  parties  or  social 

gatherings  1 

2 

3 

4 

5 

123. 

In  a car 

1 

2 

3 

4 

5 

124. 

In  a public  place  such  as  a bar  1 

or  restaurant 

2 

3 

4 

5 

125. 

On  the  street 

1 

2 

3 

4 

5 

When  you  used 

marijuana  or 

hashish  during  the 

last  year. 

how  often  did 

you  use 

it  with  each  of 

the  following 

persons?  (Circle  one  answer 

for  each . ) 

Not 

A few 

Some  Most 

Every 

at 

of  the 

of  the  of  the 

time 

all 

times 

time  time 

126. 

Alone 

1 

2 

3 

4 

5 

127. 

Husband,  wife,  partner,  or  date 

1 

2 

3 

4 

5 

128. 

Parents 

1 

2 

3 

4 

5 

129. 

Other  relatives 

1 

2 

3 

4 

5 

130. 

Friend(s)  of  your  sex  only 

1 

2 

3 

4 

5 

131 . 

Friend(s)  of  the  opposite  sex  only 

1 

2 

3 

4 

5 

132. 

Friend(s)  of  both  sexes 

1 

2 

3 

4 

5 

133. 

People  1 don't  know  too  well 

1 

2 

3 

4 

5 

Thinking  of  the  last  12  months,  on  weekends  when 

you 

used  marijuana 

or  hashish. 

how 

134. 

135. 

often  did  you  use  it?  (Circle  one  answer  for 

Never 

In  the  morning  (at  the  start  of 

your  day)  (when  you  get  up)  1 

During  the  daytime  1 

each . ) 
Seldom 

2 

2 

Some- 

times 

3 

3 

Most 

days 

4 

4 

Nearly 
every  day 

5 

5 

136. 

Dinnertime 

1 

2 

3 

4 

5 

137. 

During  the  evening 

1 

2 

3 

4 

5 

138. 

At  bedtime,  before  going  to  sleep 

1 

2 

3 

4 

5 
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On  weekdays  (during  the  week)  when  you  used  marijuana  or  hashish,  how  often 
did  you  use  it?  (Circle  one  answer  for  each.) 


Never 

Seldom 

Some- 

Most 

Nearly 

times 

days 

every  day 

139 

In  the  morning  (at  the  start  of 
your  day)  (when  you  get  up) 

1 

2 

3 

4 

5 

140 

During  the  daytime 

1 

2 

3 

4 

5 

141 

Around  dinnertime,  or  just  after 
work 

1 

2 

3 

4 

5 

142 

During  the  evening 

1 

2 

3 

4 

5 

143 

At  bedtime,  before  going  to 
sleep 

1 

2 

3 

4 

5 

We 

would  like  to  know  the  most  important 

reasons 

you  use(d)  marijuana 

in  the  last 

12 

months.  Circle  YES  for  the  most  im 

portant 

reasons 

you 

use(d) 

marijuana. 

Circle  NO  for  an  unimportant  reason. 
Do  you  use  marijuana: 


YES  NO 


144. 

To 

get  pleasure,  feel  good,  get  high 

1 

2 

145. 

To 

produce  intense  exciting  experiences 

1 

2 

146. 

To 

overcome  depression 

1 

2 

147. 

To 

go  along  with  what  my  partner  or  spouse  is  doing 

1 

2 

148. 

To 

go  along  with  what  my  friends  are  doing 

1 

2 

149. 

To 

relax,  relieve  tension 

1 

2 

150. 

To  deepen  self-understanding 

1 

2 

151 . 

To 

use  with  friends,  to  enjoy  effects 

1 

2 

152. 

For 

fun,  kicks,  excitement 

1 

2 

153. 

To 

get  away  from  my  problems,  forget  my  troubles 

1 

2 

154. 

To 

enhance  sexual  interest  or  pleasure 

1 

2 

155. 

To 

make  me  feel  more  satisfied  with  myself 

1 

2 

156. 

Other  (SPECIFY) 
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QUESTIONS  157-161  TO  BE  ANSWERED  BY  ALL  WHO  USED  MARIJUANA  AT 
LEAST  10  TO  39  TIMES,  WHETHER  OR  NOT  USED  IN  THE  LAST  12  MONTHS. 


157.  Has  there  ever  been  a period  in  your  life  when  you  used  marijuana  or  hashish 
on  a daily,  or  almost  daily,  basis  for  at  least  a month?  Circle  one  answer. 

1 Yes 

2 No  GO  TO  NEXT  SECTION,  QUESTION  162. 


158.  How  old  were  you  when  you  first  smoked  marijuana  or  hashish  that 
frequently? 

years  old 

age 


159.  Do  you  still  use  marijuana  or  hashish  on  a daily  or  near-daily  basis? 
Circle  one  answer. 

1 Yes 

2 No 


160.  If  not,  how  old  were  you  when  you  last  used  marijuana  or  hashish  that 
frequently? 

years  old 

age 


161.  Altogether,  adding  up  the  different  months  when  you  used  DAILY,  for 

about  how  much  of  your  lifetime  would  you  estimate  that  you  have  used 
marijuana  and/or  hashish  daily  or  almost  daily?  Circle  one  answer. 

1 Less  than  3 months 

2 Three  to  9 months 

3 About  1 year 

4 About  years 

5 About  2 years 

6 About  3 to  5 years 

7 Six  to  9 years 

8 Ten  or  more  years 
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How  often  have  you  ever  used  each  of  the  following  drugs  without  a 
doctor  telling  you  to  take  them?  Circle  one  answer  for  each  drug. 


Never 

1-9 

10-39 

40-59 

60-99 

150-999 

1 ,000  or 

used 

times 

times 

times 

times 

times 

more  times 

162. 

CIGARETTES  1 

or  some  other 
kind  of  tobacco 

2 

3 

4 

5 

6 

7 

163. 

BEER  1 

2 

3 

4 

5 

6 

7 

164. 

WINE  1 

2 

3 

4 

5 

6 

7 

165. 

LIQUOR  1 

2 

3 

4 

5 

6 

7 

gin,  vodka,  whiskey,  etc. 

166. 

LSD  1 

("acid,"  "trips") 

2 

3 

4 

5 

6 

7 

167. 

OTHER 

PSYCHEDELICS  1 

2 

3 

4 

5 

6 

7 

psilocybin,  mescaline, 
peyote,  "dmt,"  "stp" 

168. 

"UPS"- 

AMPHET  AMINES  1 

2 

3 

4 

5 

6 

7 

("speed,"  "pep  pills," 
"diet  pills,"  "bennies," 

"dexies" 

) 

Dexadrine,  Benzedrine, 

Dexamyl 

169. 

QUAALUDES  1 

("quads,"  "sopors") 
methaqualone 

2 

3 

4 

5 

6 

7 

170. 

"DOWNS"- 

BARBITURATES  1 

("goofballs, " "blues," 
"yellows,"  "reds") 
Seconal,  Nembutal, 
Tuinal,  phenobarbital 

2 

3 

4 

5 

6 

7 

171 . 

TRANQUILIZERS  1 
Equanil,  Miltown,  Lib- 
rium, Valium,  Thorazine 

2 

3 

4 

5 

6 

7 

172. 

COCAINE  1 

2 

3 

4 

5 

6 

7 

173. 

HEROIN  1 

2 

3 

4 

5 

6 

7 

("smack,"  "horse," 
"skag") 

174. 

OTHER  NARCOTICS, 
OPIATES  1 

2 

3 

4 

5 

6 

7 

Demerol,  Darvon 
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188.  On  the  days  that  you  drank  in  the  last  30  days,  about  how  many  drinks 
did  you  have  at  one  time  on  the  average  day?  (By  a drink,  we  mean  the 
equivalent  of  a can  of  beer,  a glass  of  wine,  or  a shot  glass  of  hard 
liquor.  ) 

0 Did  not  drink 

1 Less  than  one 

2 One  drink 

3 Two  drinks 

4 Three  drinks 

5 Four  drinks 

6 Five  drinks 

7 Six  drinks 

8 More  than  six 


189.  How  much  did  you  smoke  on  a usual  day  during  the  past  30  days? 

1 Not  at  all 

2 Less  than  one  cigarette  per  day 

3 One  to  five  cigarettes  per  day 

4 About  one-half  pack  per  day  (5-14) 

5 About  one  pack  per  day  (15-24) 

6 About  one  and  one-half  packs  per  day  (25-34) 

7 Two  packs  or  more  per  day 


As  far  as  you  know,  how  many 

of  your 

current 

friends 

use  each  of  the 

following  drugs  --  would  you 

say  all. 

most. 

some,  a 

few,  or  none? 

Circf 

one  answer  for  each  drug. 

None 

A Few 

Some 

Most 

All 

190. 

Cigarettes 

1 

2 

3 

4 

5 

191 . 

Alcoholic  beverages 

1 

2 

3 

4 

5 

192. 

Marijuana 

1 

2 

3 

4 

5 

193. 

Pills,  such  as  ups. 

downers,  or  tranquilizers  . 

1 

2 

3 

4 

5 

194. 

Heroin 

1 

2 

3 

4 

5 

19 


SES  and  ECONOMICS 


Family  of  Origin 

195.  What  is  the  highest  grade  of  school  your  mother  completed?  How  about 
your  father?  Check  one  for  each  person. 

196. 

Mother  Father 

None  

Elementary  (1 ,2, 3, 4, 5, 6, 7, 8) 

High  School  (9,10,11,12)  

Undergraduate  college  (1,2, 3, 4+)  

Postgraduate  (5  or  more)  

Don't  know  or  inapplicable  


What  was  or  is  your  father's  main  occupation?  What  kind  of  work  did  (does) 
he  usually  do?  In  what  kind  of  business  or  industry  is  that? 


197.  

(occupational  title  or  duties) 


198.  

(business  or  industry) 


199.  Was  (is)  your  mother  employed  all,  most,  some,  or  none  of  the  time  outside 
of  the  home?  Circle  one  number. 

1 . All  of  the  time 

2.  Most  of  the  time 

3.  Some  of  the  time 

4.  None  of  the  time 


What  was  or  is  your  mother's  main  occupation?  What  kind  of  work  did  (does) 
she  usually  do?  In  what  kind  of  business  or  industry  is  that? 


200.  

(occupational  title  or  duties) 


201.  

(business  or  industry) 
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202.  Who  was  (is)  the  main  wage  earner  in  your  family?  Circle  one  number. 

1 . Father 

2.  Mother 

3.  Both 

4.  Other  (explain  ) 


203.  Are  you  currently  enrolled  in  school  or  will  you  be  entering  school  in  the 
very  near  future?  Circle  one  number. 

1 . Yes 

2.  No 


204.  What  is  (was)  the  last  year  in  school  you  completed?  Circle  one  grade. 

None 

Elementary  (1 ,2, 3, 4, 5, 6, 7, 8) 

High  School  (9,10,11,12) 

Undergraduate  college  (1,2, 3, 4+) 

Postgraduate  (5  or  more)  (Specify  highest  degree:  ) 


205.  Are  you  employed  now?  Circle  one  number. 

1 . Yes 

2.  No 


206.  How  many  hours  a week  do  you  usually  work?  

(hours) 


What  is  your  occupation?  What  kind  of  work  do  you  do?  In  what  kind  of 
industry  is  that? 


207.  

(occupational  title  or  duties) 


208.  

(business  or  industry) 
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209.  During  all  of  the  last  calendar  year  (January  1 through  December  31),  what 
percentage  of  your  financial  support  came  from  each  of  the  following  sources? 

a.  Yourself  % 

b.  Your  spouse  or  person  you  live  with % 

c.  Your  parents  % 

d.  Unemployment  compensation  % 

e.  Welfare  (ADC,  food  stamps,  etc.)  % 

f.  All  other  sources  % 

Total  of  above  100  % (Make  sure  a-f  total  to  100%) 

210.  How  much  money  did  you  make  last  yeai — before  taxes?  

211.  If  your  spouse  or  the  person  you  live  with  had  an  income  last  year  and 

your  incomes  were  pooled,  how  much  was  your  total  income  before  taxes? 


212.  Compared  with  other  persons  of  your  age  and  sex,  do  you  feel  that  you 
are  advancing  in  your  job  or  career: 

Less  quickly  than  others 

About  as  quickly  as  others 

More  quickly  than  others 


During  the  past  2 years,  have  you  changed  employers: 


213.  Because  you  got  fired: 

214.  Because  you  thought  you 

1 . 

No 

2.  Yes 

Number 

of 

times 

were  going  to  be  fired: 

1 . 

No 

2.  Yes 

Number 

of 

times 

215.  Got  fed  up  with  the  job: 

1 . 

No 

2.  Yes 

Number 

of 

times 

216.  Got  a better  job: 

1 . 

No 

2.  Yes 

Number 

of 

times 

217.  How  satisfied  are  you  with  the  job  you  now  hold? 

1.  Completely  satisfied 

2.  Quite  satisfied 

3.  Ambivalent,  neither  satisfied  nor  dissatisfied 

4.  Quite  dissatisfied 

5.  Completely  dissatisfied 
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Religiosity 


218.  What  is  your  religious  preference?  (Circle  your  answer.) 

a.  Baptist 

b.  Churches  of  Christ 

c.  Disciples  of  Christ 

d.  Episcopal 

e.  Lutheran 

f.  Methodist 

g.  Presbyterian 

h.  United  Church  of  Christ 

i.  Other  Protestant  (explain  ) 

j.  Unitarian 

k.  Roman  Catholic 

l.  Eastern  Orthodox 

m.  Jewish  (check  one) 

Orthodox 

Conservative 

Reformed 

n.  Other  religion  (explain  ) 

o.  I have  no  religious  preference  now 

I used  to  have  a religious  preference,  but  now  I am  unaffiliated 

I have  never  been  affiliated  with  a religious  organization. 


219.  How  often  do  you  attend  religious  services?  (Circle  one  answer.) 

1 . Never 

2.  Rarely 

3.  About  once  or  twice  a month 

4.  About  once  a week  or  more  often 


220.  How  important  is  religion  in  your  life?  (Circle  one  answer.) 

1 . Not  important 

2.  A little  important 

3.  Pretty  important 

4.  Very  important 
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INTERPERSONAL  RELATIONS 


221.  At  present,  are  you:  (Circle  one.) 

a)  Married  and  living  with  your  wife/husband 

b)  Living  as  a partner  with  someone  to  whom  you  are  not  married 

c)  Living  at  home  with  your  family  [parent(s),  siblings] 

d)  Living  with  a roommate  of  the  same  sex 

e)  Living  alone 

If  you  circled  a or  b,  continue  to  question  222. 

If  you  circled  c,  d,  or  e,  go  to  question  241. 


222.  How  many  times  have  you  been  married?  (Circle  one  answer.) 

0 1 2 or  more 


223.  How  many  times  have  you  lived  as  a partner  for  6 months  or  more  with 

someone  to  whom  you  were  not  married  at  the  time?  (Circle  one  answer.) 

0 1 2 or  more 


Most  persons  have  disagreements  in  their  relationships.  Please  indicate  the 
approximate  extent  of  agreement  between  you  and  your  partner  on  the 
following  items.  Circle  one  answer  for  each. 

Always  Frequently  Occas-  Almost  Always 

disagree  disagree  sionally  always  agree 

disagree  agree 


224.  Handling  finances  1 

225.  Leisure  time  interests/  1 

activities 

226.  Religious  matters  1 

227.  Friends  1 

228.  Sex  relations  1 

229.  Amount  of  time  1 

spent  together 

230.  Aims,  goals,  things  1 

believed  important 

231.  Philosophy  of  life  1 

232;  Correct  or  proper  1 

behavior 

233.  Ways  of  dealing  with  1 

parents  (in-laws) 

234.  Making  major  decisions  1 


2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 


3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 


4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 


5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 
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(Circle  one  answer  for 


All  things  considered,  how  satisfied  are  you  with: 
each . ) 


Com- 

Quite 

Some- 

Neither 

Some- 

Quite 

Com- 

pletely 

dis- 

what 

or 

what 

satis- 

pletely 

dis- 

satis- 

dis- 

mixed 

satis- 

fied 

satisfied 

satisfied 

fied 

satisfied 

feeling 

fied 

235.  Your  partner  1 2 3 4 5 6 7 

236.  Your  relationship  1 2 3 4 5 6 7 

237.  Your  relationship 

with  your  partner  1 2 3 4 5 6 7 


238.  Generally  speaking,  how  do  you  usually  feel  toward  your  partner? 

a.  I always  feel  affectionate 

b.  I usually  feel  affectionate 

c.  About  half  the  time  I feel  dislike,  and  half  the  time  affectionate 

d.  I usually  feel  dislike 

e.  I always  feel  dislike 


239.  Generally  speaking,  how  often  do  you  and  your  partner  have  sexual  relations? 


240. 


a.  More  than  twice  a week 

b.  Once  or  twice  a week 

c.  Once  every  2 weeks 

d.  Less  than  every  2 weeks,  but  at  least  once  a month 

e.  Less  than  once  a month 

f.  Almost  never 


How  much  of  your  free  time  do  you  actually  spend  with  your  partner? 

a.  All  or  almost  all  of  it 

b.  About  half  of  it 

c.  Little  or  none  of  it 


241.  Do  you  have  any  children?  Yes  If  yes,  how  many 

No 


242.  All  things  considered,  how  satisfied  have  you  been  with  your  experience 
of  being  a parent? 

a.  Am  not  a parent 

b.  Completely  dissatisfied 

c.  Quite  dissatisfied 

d.  Somewhat  dissatisfied 

e.  Neither  or  mixed  feelings 

f.  Somewhat  satisfied 

g.  Quite  satisfied 

h.  Completely  satisfied 
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243.  Generally  speaking,  how  comfortable  do  you  usually  feel  being  alone  and 
doing  things  with  your  child  (children)? 

a.  I always  feel  very  comfortable 

b.  I usually  feel  pretty  comfortable 

c.  About  half  the  time  I feel  pretty  comfortable 

d.  I usually  feel  pretty  uncomfortable 

e.  I always  feel  very  uncomfortable 

f.  Am  not  a parent 


244.  Generally  speaking,  how  do  you  usually  feel  toward  your  children? 

a.  I almost  always  feel  affection 

b.  I usually  feel  affection 

c.  About  half  the  time  I feel  affection 

d.  Most  of  the  time  I do  not  feel  affection 

e.  I hardly  ever  feel  affection  toward  them 

f.  Am  not  a parent 


245.  On  average,  how  often  do  you  date  in  a month? 

a.  Five  or  more  times 

b.  Four  times 

c.  Three  times 

d.  Once  or  twice 

e.  Never 


246.  All  things  considered,  how  satisfied  are  you  with  your  life  as  a single 
person  - would  you  say  you  are.... 

a.  Completely  dissatisfied 

b.  Quite  dissatisfied 

c.  Somewhat  dissatisfied 

d.  Neither  or  mixed  feelings 

e.  Somewhat  satisfied 

f.  Quite  satisfied 

g.  Completely  satisfied 

h.  Not  single 


247.  All  things  considered,  how  satisfied  are  you  with  your  relationship(s)  with 
the  people  you  date? 


a.  Completely  dissatisfied 

b.  Quite  dissatisfied 

c.  Somewhat  dissatisfied 

d.  Neither  or  mixed  feelings 

e.  Somewhat  satisfied 

f.  Quite  satisfied 

g.  Completely  satisfied 


26 


248.  Generally  speaking,  how  do  you  usually  feel  toward  your  partner(s)  or  the 
people  you  date? 

a.  I always  feel  affectionate 

b.  I usually  feel  affectionate 

c.  About  half  the  time  I feel  dislike,  and  half  the  time  affectionate 

d.  I usually  feel  dislike 

e.  I always  feel  dislike 

Are  your  mother  and  father  alive? 

249.  Father  (if  deceased,  how  old  were  you  at  the  time  ) 

250.  ~~  Mother  (if  deceased,  how  old  were  you  at  the  time  ) 


251.  Are  they  still  married  to  each  other? 

1.  Yes  (If  yes  go  on  to  question  253) 

2.  No  (If  no,  how  old  were  you  when  your  parents  parted?  ) 


252.  Are  either  or  both  of  them  remarried? 

Father  still  unmarried 

Father  remarried 

Mother  still  unmarried 

Mother  remarried 


253.  How  many  older  and  younger  brothers  and  sisters  do  you  have? 

Older  brothers 

Older  sisters 

Younger  brothers 

Younger  sisters 


How  close  do  you  feel  to  the  following  family  members?  Circle  one  answer 
for  each.  Use  this  scale: 

Not  Very  Dis-  Neither  Very 

applicable  distant  tant  close  nor  Close  close 

distant 


254.  Your  father  0 

255.  Your  mother  0 

256.  Your  brothers  0 

257.  Your  sisters  0 


1 2 3 
1 2 3 
1 2 3 
1 2 3 


4 

4 

4 

4 


5 

5 

5 

5 
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How  often  do  you  visit  with  the  following  family  members?  Circle  one  an 
swer  for  each.  Use  this  scale: 


Not  Never  Less  than  At  least  At  least  Daily 

applicable  once  a monthly  weekly 

month 


258.  Your  father 

259.  Your  mother 

260.  Your  brothers 

261 . Your  sisters 


0 

0 

0 

0 


1 

1 

1 

1 


2 

2 

2 

2 


3 

3 

3 

3 


4 

4 

4 

4 


5 

5 

5 

5 


262.  How  many  children  live  at  home  with  you? 
0 

1 or  more 

263.  What  are  their  ages?  , , , 


264.  How  satisfied  are  you  with  your  experiences  as  a parent? 

a.  Completely  dissatisfied 

b.  Quite  dissatisfied 

c.  Somewhat  dissatisfied 

d.  Neither  or  mixed  feelings 

e.  Somewhat  satisfied 

f.  Quite  satisfied 

g.  Completely  satisfied 


265.  About  how  many  close  friends  do  you  have--people  you  can  feel  at  ease 

with  and  can  talk  to  about  what's  on  your  mind?  (You  may  include  rela- 
tives). 


close  friends 


266.  Which  of  the  following  best  describes  the  way  you  usually  feel  in  a social 
situation? 

a.  Always  uneasy 

b.  Usually  uneasy 

c.  Sometimes  uneasy 

d.  Rarely  uneasy  ^ 

e.  Never  uneasy 
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267.  Thinking  now  of  the  ways  you  like  to  spend  your  free  time,  how  often  do 
you  feel  you  have  a strong  need  to  get  away  from  people  and  do  things  by 
yourself? 

a.  Often 

b.  Fairly  often 

c.  Occasionally 

d.  Seldom 

e.  Never 


268.  How  often  do  you  find  yourself  feeling  either  annoyed  or  angry  with  other 
people? 

a.  Very  often 

b.  Fairly  Often 

c.  Occasionally 

d.  Seldom 

e.  Never 
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PSYCHOSOCIAL  ASPECTS  OF  DRUG  USE 


Circle  the  number  for  "yes"  or  "no"  to  indicate  your  aswer  to  each  of  the  following 
questions.  Circle  one  number  for  each  question. 


YES  NO 


269.  Do  you  find  smoking  marijuana  in  the  morning  makes 

it  easier  to  start  the  day?  1 2 

270.  Do  you  think  you  would  find  it  hard  to  get  through 

an  entire  week  without  smoking  some  marijuana?  1 2 

271.  Have  you  made  arrangements  for  assuring  yourself 

a regular  consistent  supply  of  marijuana?  1 2 

272.  Do  you  find  that  much  of  your  social  life  takes  place 

while  you  have  been  smoking  marijuana?  1 2 

273.  Do  you  feel  that  marijuana  can  be  used  approximately 

in  almost  any  context--for  example,  at  work,  at  home,  1 2 

or  out  socially-by  an  experienced  user? 

274.  Do  you  feel  that  being  a regular  and  experienced  user 

of  marijuana  is  an  important  thing  you  have  in  common  1 2 

with  most  of  your  friends? 

275.  Have  you  ever  sold  drugs  illegally,  as  a favor  for  a 

friend?  1 2 

276.  Have  you  ever  sold  drugs  illegally  to  pay  for  your 

own  supply?  1 2 

277.  Have  you  ever  sold  drugs  illegally  for  a profit?  1 2 
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LIFE  SATISFACTION 


Consider  how  things  have  been  going  for  you  during  the  last  few  weeks.  Below 
is  a list  of  things  that  can  influence  your  happiness  and  satisfaction  with  life. 
Please  read  each  item  and  indicate  how  you  have  felt  about  it  over  the  last  few 
weeks.  Indicate  whether  you  have  felt  terrible,  unhappy,  mostly  dissatisfied, 
mixed,  mostly  satisfied,  pleased,  delighted.  Circle  one  answer  for  each. 


Terrible  Unhappy  Mostly  Mixed  Mostly  Pleased  Delighted 

dis-  satisfied 

satisfied 


Over  the  last  few  weeks, 
how  have  you  felt  about: 


278. 

Your  overall  satisfac- 
tion with  your  work  1 
(including  being  a 
student  or  housewife) 

2 

3 

4 

5 

6 

7 

279. 

The  amount  of 
income  you  have  1 

2 

3 

4 

5 

6 

7 

280. 

The  amount  of  pay 
you  get  for  the  1 

amount  of  work 
you  do 

2 

3 

4 

5 

6 

7 

281. 

Your  liking  for  the 
actual  work  itself  1 

that  is  involved  in 
your  job 

2 

3 

4 

5 

6 

7 

282. 

The  physical  surroun- 
dings and  working  1 

conditions  in  your  job 

2 

3 

4 

5 

6 

7 

283. 

The  amount  of  job 
security  you  have  1 

2 

3 

4 

5 

6 

7 

284. 

Your  overall  health  1 

2 

3 

4 

5 

6 

7 

285. 

Your  overall  physical 
condition  1 

2 

3 

4 

5 

6 

7 

286. 

The  amount  of  time 
you  have  for  doing  1 

things  you  want  to  do 

2 

3 

4 

5 

6 

7 
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Terrible 

Unhappy  Mostly  Mixed 
dis- 
satisfied 

Mostly 

satisfied 

Pleased 

Delighted 

287. 

The  chances  you  have 
for  recreation  and  1 

just  taking  it  easy 

2 

3 

4 

5 

6 

7 

288. 

What  you  are  accomp- 
lishing with  your  life  1 

2 

3 

4 

5 

6 

7 

289. 

Your  ability  to  change 
things  around  you  1 

that  you  don't  like 

2 

3 

4 

5 

6 

7 

290. 

How  interesting  your 
day  to  day  life  is  1 

2 

3 

4 

5 

6 

7 

291. 

Your  ability  to  satisfy 
and  meet  your  needs  1 

2 

3 

4 

5 

6 

7 

292. 

The  fullness  and  com- 
pleteness of  your  1 

love/sex  life 

2 

3 

4 

5 

6 

7 

293. 

Your  ability  to 
handle  your  emotions  1 
and  feelings 

2 

3 

4 

5 

6 

7 

294. 

Your  religious  life  1 

2 

3 

4 

5 

6 

7 

295. 

The  enjoyment  you 
experience  when  you  1 
are  around  other 
people 

2 

3 

4 

5 

6 

7 

296. 

How  honest  and 
sincere  other  people  1 
are  with  you 

2 

3 

4 

5 

6 

7 

297. 

Your  ability  to  gain 
cooperation  from  1 

other  persons 

2 

3 

4 

5 

6 

7 

298. 

Your  general  enjoy- 
ment of  life  1 

2 

3 

4 

5 

6 

7 

299. 

Your  sensitivity  to 
other  persons'  1 

feelings 

2 

3 

4 

5 

6 

7 
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Terrible  Unhappy  Mostly  Mixed  Mostly  Pleased  Delighted 

dis-  satisfied 

satisfied 


300. 

Your  standard  of  living: 

the  things  you  have 
such  as  housing, 
car,  furniture,  re- 
creation, etc. 

1 

2 

3 

4 

5 

6 

7 

301 . 

How  consistent  and 
understandable  your 
world  seems  to  be 

1 

2 

3 

4 

5 

6 

7 

302. 

The  degree  of  love 
and  acceptance  you 
feel  from  others 

1 

2 

3 

4 

5 

6 

7 

303. 

How  happy  you  are 

1 

2 

3 

4 

5 

6 

7 

304. 

Your  independence 
and  freedom:  the 
chance  to  do  what 
you  want  to  do 

1 

2 

3 

4 

5 

6 

7 

305. 

How  you  have  handled 

problems  that  have 
come  up 

1 

2 

3 

4 

5 

6 

7 

306. 

How  much  fun  you 
are  having 

1 

2 

3 

4 

5 

6 

7 

307. 

Your  ability  to  take 
it  when  things  get 
tough 

1 

2 

3 

4 

5 

6 

7 

308. 

The  amount  of  inti- 
macy and  warmth 
in  your  life 

1 

2 

3 

4 

5 

6 

7 

309. 

The  respect  you  get 
from  others 

1 

2 

3 

4 

5 

6 

7 

310. 

Your  ability  to  adjust 
to  changes  that  come 
along 

1 

2 

3 

4 

5 

6 

7 

311 . 

Your  ability  to  get 
along  with  other 
people 

1 

2 

3 

4 

5 

6 

7 
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Terrible  Unhappy  Mostly  Mixed  Mostly  Pleased  Delighted 

dis-  satisfied 

satisfied 


312. 

The  amount  of  friend- 
ship and  love  in  1 

your  life 

2 

3 

4 

5 

6 

7 

313. 

Your  own  family  life  1 

2 

3 

4 

5 

6 

7 

314. 

Your  close  relatives: 
parents,  brothers,  1 

sisters,  in-laws,  etc. 

2 

3 

4 

5 

6 

7 

315. 

The  things  you  do  and 
the  times  you  have  1 

with  friends 

2 

3 

4 

5 

6 

7 

316. 

The  standards  and 
values  in  today's  1 

society 

2 

3 

4 

5 

6 

7 

317. 

Your  prospects  for 
a good  life  in  the  1 

future 

2 

3 

4 

5 

6 

7 

318. 

Your  success  in  getting 
ahead  in  the  world  1 

2 

3 

4 

5 

6 

7 

319. 

Your  ability  to  con- 
centrate 1 

2 

3 

4 

5 

6 

7 

320. 

Your  ability  to  get 
things  done  effi-  1 

ciently 

2 

3 

4 

5 

6 

7 

321 . 

Your  ability  to  express 
your  ideas  to  others  1 

2 

3 

4 

5 

6 

7 

322. 

Your  ability  to  share 
your  feelings  with 
persons  who  are  1 

close  to  you 

2 

3 

4 

5 

6 

7 

323. 

Your  ability  to  think 
things  through  and  1 

come  up  with  good 
answers 

2 

3 

4 

5 

6 

7 
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Wishes 


Nobody's  life  is  absolutely  perfect  in  all  respects.  Just  about  everyone  wishes 
things  could  be  different  in  certain  ways.  Please  consider  what  might  make 
your  life  better  than  it  is  now.  Mark  "yes"  for  those  things  in  the  list  below 
that  you  wish  could  be  different.  Mark  "no"  for  those  things  which  you  do  not 
wish  were  different.  Circle  one  answer  for  each. 


YES  NO 


324. 

A better  education 

1 

2 

325. 

More  satisfaction  with  your  work 

1 

2 

326. 

Better  health 

1 

2 

327. 

Fewer  money  problems 

1 

2 

328. 

More  fun  in  your  life 

1 

2 

329. 

A more  secure  job  situation 

1 

2 

330. 

More  interesting  work 

1 

2 

331. 

A better  body 

1 

2 

332. 

A more  settled  life 

1 

2 

333. 

Greater  freedom  to  be  yourself 

1 

2 

334. 

More  recognition  for  things  you  do  well 

1 

2 

335. 

Greater  happiness 

1 

2 

336. 

Greater  warmth  and  intimacy  in  your  relationships 

1 

2 

337. 

An  improved  standard  of  living 

1 

2 

338. 

Greater  success  in  your  career 

1 

2 

339. 

Better  control  over  your  emotions  and  feelings 

1 

2 

340. 

Less  pressure  in  life 

1 

2 

341 . 

More  independence  and  freedom 

1 

2 

342. 

A better  memory 

1 

2 

343. 

An  easier  time  of  it  in  solving  problems  that  come  up 

1 

2 

344. 

Fewer  problems  in  life 

1 

2 

345. 

A better  sex  life 

1 

2 

346. 

Better  understanding  of  yourself 

1 

2 

347. 

More  closeness  in  your  immediate  family 

1 

2 

348. 

More  time  for  recreation 

1 

2 

349. 

More  influence  over  things  that  affect  you 

1 

2 

350. 

Less  boredom  in  your  life 

1 

2 

351. 

A more  active  life  physically 

1 

2 

352. 

A more  active  life  socially 

1 

2 

353. 

Fewer  emotional  upsets 

1 

2 

354. 

A deeper  religious  commitment 

1 

2 

355. 

Greater  sensitivity  for  others'  feelings 

1 

2 

356. 

More  nice  things  in  life 

1 

2 

357. 

More  friends  who  you  can  really  count  on  • 

1 

2 

358. 

Fewer  worries  in  life 

1 

2 

359. 

Fewer  hassles  with  authorities  (such  as  teachers, 
employers,  police,  etc.) 

1 

2 

360. 

Fewer  changes  in  life 

1 

2 

361 . 

A better  future  to  look  forward  to 

1 

2 

362. 

More  excitement  and  enthusiasm  in  life 

1 

2 

363. 

An  easier  life  in  general 

1 

2 
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Overall  Life  Satisfaction 


Think  about  how  you  feel  about  your  life  in  general.  Look  at  the  boxes  and 
descriptions  below  and  consider  which  descriptions  fit  best  according  to  how 
your  life  was  1 year  ago  (last  year),  how  it  is  now,  and  what  you  expect 
your  life  to  be  like  1 year  from  now  (next  year). 

Considering  your  life  as  a whole,  rate  yourself  on; 


364.  How  things  were  this  time  a year  ago:  Check  one  box  only  under  "Last  Year." 


365.  How  things  are  (going)  at  present:  Check  one  box  only  under  "Now. " 


366.  How  you  think  your  life  situation  will  most  likely  be  this  time  a year  from  now 
Check  one  box  only  under  "Next  Year." 


LAST  NEXT 

YEAR  NOW  YEAR 


[ 

] 

10 

[ 

] 

10 

[ 

] 

10 

....  Absolutely  tops,  could  not  be  better 

[ 

] 

9 

[ 

] 

9 

[ 

] 

9 

....  Very  good,  could  hardly  be  better 

[ 

] 

8 

[ 

] 

8 

[ 

] 

8 

....  Actually  quite  good 

[ 

] 

7 

[ 

] 

7 

[ 

] 

7 

....  Pretty  good 

[ 

] 

6 

[ 

] 

6 

[ 

] 

6 

....  Somewhat  good  (good  aspects  slightly 
outweigh  the  bad) 

[ 

] 

5 

[ 

] 

5 

[ 

] 

5 

....  Good  and  bad  aspects  about  even 

[ 

] 

4 

[ 

] 

4 

[ 

] 

4 

....  Somewhat  bad  (bad  aspects  slightly 
outweigh  the  good) 

[ 

] 

3 

[ 

] 

3 

[ 

] 

3 

....  Pretty  bad 

[ 

] 

2 

[ 

] 

2 

[ 

] 

2 

....  Actually  quite  bad 

[ 

] 

1 

[ 

] 

1 

[ 

] 

1 

....  Very  bad,  could  hardly  be  worse 

[ 

] 

0 

[ 

] 

0 

[ 

] 

0 

....  Absolute  bottom--could  not  be  worse 

367.  Think  for  a moment  about  other  people  of  your  age  and  sex  that  you  know. 
For  the  most  part,  how  are  their  lives?  Using  the  same  scale  from  0 to  10, 
what  would  be  the  rating  for  most  of  them  right  NOW?  Circle  one  of  the 
numbers  below  to  indicate  that  rating. 

0123456789  10 
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PSYCHOLOGICAL  HEALTH 


Below  is  a list  of  problems  and  complaints  that  people  sometimes  have.  Read  each 
one  carefully.  INDICATE  HOW  MUCH  THAT  PROBLEM  HAS  BOTHERED  OR  DIS- 
TRESSED YOU  DURING  THE  PAST  WEEK  INCLUDING  TODAY.  Circle  one  answer 
for  each  problem.  Use  the  following  scale: 


Not  at  A little  Moder- 

all  bit  ately 


Quite  a 
bit 


Extremely 


HOW  MUCH  WERE  YOU 
BOTHERED  BY: 

368. 

Nervousness  or  shakiness 
inside 

1 

2 

3 

4 

5 

369. 

The  idea  that  someone  else 
can  control  your  thoughts 

1 

2 

3 

4 

5 

370. 

Feeling  others  are  to  blame 
for  most  of  your  troubles 

1 

2 

3 

4 

5 

371. 

Thoughts  of  ending  your  lifel 

2 

3 

4 

5 

372. 

Hearing  voices  that  other 
people  do  not  hear 

1 

2 

3 

4 

5 

373. 

Suddenly  scared  for  no 
reason 

1 

2 

3 

4 

5 

374. 

Temper  outbursts  that  you 
could  not  control 

1 

2 

3 

4 

5 

375. 

Feeling  blue 

1 

2 

3 

4 

5 

376. 

Feeling  that  people  are 
unfriendly  or  dislike  you 

1 

2 

3 

4 

5 

377. 

Having  to  check  and 
double-check  what  you  do 

1 

2 

3 

4 

5 

378. 

Difficulty  making  decisions 

1 

2 

3 

4 

5 

379. 

Feeling  hopeless  about 
the  future 

1 

2 

3 

4 

5 

380. 

Feeling  tense  or  keyed  up 

1 

2 

3 

4 

5 

381. 

Feeling  uneasy  when  people 
are  watching  or  talking 
about  you 

1 

2 

3 

4 

5 
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Extremely 


Not  at  A little  Moder-  Quite  a 

all  bit  ately  bit 


382. 

Having  urges  to  beat, 
injure,  or  harm  someone 

1 

2 

3 

4 

5 

383. 

Having  urges  to  break 
or  smash  things 

1 

2 

3 

4 

5 

384. 

Feeling  very  self-conscious  1 
with  others 

2 

3 

4 

5 

385. 

Spells  of  terror  or  panic 

1 

2 

3 

4 

5 

386. 

Feelings  of  worthlessness 

1 

2 

3 

4 

5 

387. 

Feeling  most  people  will 
take  advantage  of  you  if 
you  let  them 

1 

2 

3 

4 

5 

The  following  questions  concern 

your 

feelings  about  yourself. 

How  much  do  you 

agree  or  disagree  with  each  of 
statement. 

these 

statements? 

Strongly 

Disagree 

Circle  one  answer  for 
Disagree  Agree 

each 

Strongly 

Agree 

388. 

1 wish  1 could  have  more 
respect  for  myself 

1 

2 

3 

4 

389. 

At  times  1 think  1 am  no 
good  at  all 

1 

2 

3 

4 

390. 

1 certainly  feel  useless  at 

times 

1 

2 

3 

4 

This  section  of  the  examination  contains  questions  about  how  you  feel  and  how 
things  have  been  going  with  you.  For  each  question,  check  (V)  the  answer 
which  best  applies  to  you. 


391.  How  well  were  you  able  to  satisfy  or  meet  most  of  your  needs?  (DURING 
THE  PAST  MONTH) 

1.  ( ) All  my  needs  were  completely  satisfied 

2.  ( ) Most  of  my  needs  were  generally  satisfied 

3.  ( ) About  half  of  my  needs  were  reasonably  satisfied 

4.  ( ) Only  a few  of  my  needs  were  reasonably  satisfied 

5.  ( ) I could  not  satisfy  my  most  important  needs 
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392. 


393. 


394. 


395. 


396. 


Did  you  take  care  of  or  do  most  things  as  well  as  you  should  have? 

(DURING  THE  PAST  MONTH) 

1.  ( ) No,  because  I was  too  emotionally  disturbed 

2.  ( ) No,  because  I was  physically  sick,  ill,  or  impaired 

3.  ( ) No,  because  I did  not  want  to  or  felt  bored 

4.  ( ) No,  because  too  many  demands  were  made  on  my  time 

5.  ( ) No,  because  I was  trying  to  do  too  many  things 

6.  ( ) Yes,  I took  care  of  most  of  the  things  I should  have 

I felt  eager  to  tackle  my  daily  tasks  or  make  decisions.  (DURING  THE  PAST 
MONTH) 

1 . ( ) None  of  the  time 

2.  ( ) A little  of  the  time 

3.  ( ) Some  of  the  time 

4.  ( ) A good  bit  of  the  time 

5.  ( ) Most  of  the  time 

6.  ( ) All  of  the  time 

I felt  proud  or  good  about  some  things  I did.  (DURING  THE  PAST  MONTH) 

1 . ( ) None  of  the  time 

2.  ( ) A little  of  the  time 

3.  ( ) Some  of  the  time 

4.  ( ) A good  bit  of  the  time 

5.  ( ) Most  of  the  time 

6.  ( ) All  of  the  time 

I felt  I could  easily  handle  or  cope  with  any  serious  problem  or  major  change 
in  my  life  if  I had  to.  (DURING  THE  PAST  MONTH) 

1 . ( ) None  of  the  time 

2.  ( ) A little  of  the  time 

3.  ( ) Some  of  the  time 

4.  ( ) A good  bit  of  the  time 

5.  ( ) Most  of  the  time 

6.  ( ) All  of  the  time 

Have  you  ever  felt  that  you  were  going  to  have  or  were  close  to  having 
a nervous  breakdown? 

1.  ( ) YES  --  during  the  past  year  and  I still  feel  near  one 

2.  ( ) YES  — during  the  past  year  but  I ^ not  feel  near  one  now 

3.  ( ) YES  --  more  than  a year  ago,  and  I am  not  completely  over  it  yet 

4.  ( ) YES  --  more  than  a year  ago,  but  I am  completely  over  it  now 

5.  ( ) NO  --  never 
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401.  Ability  to  have  a good  time 
with  friends 
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407.  General  self-confidence 
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Long-Term  Effects  of  Drug  Use 


Using  alcohol,  marijuana,  or  other  drugs  sometimes  leads  to  changes  in  people's  lives.  For 
each  item  listed  below,  please  check  whether  you  think  alcohol  has  improved , impaired,  or 
had  no  effect  on  your  life.  Then  do  the  same  for  marijuana.  For  "OTHER  DRUG",  check 
only  those  items  where  you  perceive  an  improvement  or  an  impairment,  and  write  in  the  name 
of  the  drug  that  probably  caused  it.  What  we  are  asking  about  here  is  long-term  effects, 
not  the  effects  you  experience  just  after  taking  the  drug. 


ALCOHOL 


Im- 

Im- 

No 

proved 

paired 

effect 

LONG 

-TERM 

EFFECT  ON  YOUR. . . 

435. 

Physical  health 

□ 

□ 

□ 

436. 

General  self- 

confidence 

□ 

□ 

□ 

437. 

Relations  with 

your  parents 

□ 

□ 

□ 

438. 

Relations  with  other 

members  of  your 

□ 

D 

□ 

family 

439. 

Work  performance 

(including  school 

□ 

□ 

□ 

and  housework) 

440. 

Ability  to  cope  and 

solve  life's  problems 

□ 

□ 

□ 

441 . 

Ability  to  be  tolerant 

abd  considerate  of 

□ 

□ 

□ 

others 

442. 

Relations  with  em- 

ployers or  teachers 

□ 

□ 

□ 

443. 

Creativity 

□ 

□ 

□ 

444. 

Sense  of  purpose  and 

meaning  in  your  life 

□ 

□ 

□ 

445. 

General  level  of 

energy 

□ 

□ 

□ 

446. 

Judgment 

□ 

□ 

□ 

OTHER  DRUG 

MARIJUANA  Name  of 

Im-  Im-  No  Im-  Im-  DRUG  if 


proved 

paired 

effect 

proved 

paired  effect  is 
checked 
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LONG-TERM 
EFFECT  ON  YOUR... 

ALCOHOL 

Im-  Im- 

proved paired 

No 

effect 

MARIJUANA 

Im-  Im- 

proved paired 

No 

effect 

OTHER 

Im- 

proved 

DRUG 

Im- 

paired 

Name  of 
OTHER 
DRUG  if 
effect  is 
checked 

447. 

Overall  happiness 

□ 

o 

□ 

□ 

□ 

□ 

□ 

□ 

448. 

Relations  with  close 
friends 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

449. 

Relations  with  your 
spouse  or  sex 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

partner(s) 

450. 

Ability  to  concentrate 
on  complex  tasks 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

451. 

Self-understanding 

□ 

o 

□ 

□ 

□ 

□ 

□ 

□ 

452. 

Understanding  of 
other  people 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

453. 

Ability  to  avoid  acci- 
dents (auto  and 

□ 

□ 

□ 

□ 

□ 

o 

□ 

□ 

other) 

454. 

Ambition 

□ 

□ 

□ 

□ 

D 

□ 

□ 

□ 

455. 

Ability  to  enjoy  life 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

456. 

Relations  with  class- 
mates, co-workers, 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

and  other  acquaintances 

457. 

Emotional  stability 

a 

□ 

□ 

□ 

Q 

□ 

□ 

□ 

458. 

Ability  to  get  things 
done 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

459. 

Ability  to  get  ahead 
in  your  career 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

460. 

Memory 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

461, 

Ability  to  think 
clearly 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

462. 

Dependability  and 
trustworthiness 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

463. 

Ability  to  avoid  shy- 
ness and  feel  at  ease 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

□ 

with  other  people 
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ALCOHOL 

Im-  Im-  No 
proved  paired  effect 

LONG-TERM 
EFFECT  ON  YOUR. . . 


464. 

Ability  to  avoid  legal 

problems  or  trouble  □ 

□ 

□ 

with  police 

465. 

Ability  to  stick  with 

tough  situations  and  □ 

□ 

□ 

see  them  through 

466. 

Excitement  and  enthu- 

siasm for  life  □ 

□ 

□ 

467. 

Ability  to  work  for  and 

get  things  you  want  □ 

□ 

□ 

468. 

Ability  to  overcome 

worry  and  anxiety  □ 

□ 

□ 

469. 

Ability  to  enjoy  varied 

and  numerous  □ 

□ 

□ 

activities 

470. 

Self-control  and  ability 

to  stay  out  of  trouble  □ 

□ 

□ 

471. 

Educational  progress 

and  achievement  o 

□ 

□ 

472. 

General  satisfaction 

with  yourself  □ 

□ 

□ 

473. 

General  satisfaction 

with  life  □ 

o 

□ 

MARIJUANA  OTHER  DRUG  Name  of 

OTHER 

Im-  Im-  No  Im-  Im-  DRUG  if 

proved  paired  effect  proved  paired  effect  is 

checked 


□ □ □ □ □ 


o o □ □ □ 


□ □ □ □ □ 


□ □□an 


□ □ □ □ □ 


□ □ □ □ □ 


□ □ □ □ □ 


□ □ □ □ □ 


□ □ □ □ □ 


□ □ □ □ □ 
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The  UCLA  Center  undertook  a process  by  which  the  completed  questionnaire  was  empirically 
evaluated  by  the  contributors.  This  stage  in  the  feedback  process  allowed  the  contributors  to 
consider  the  whole  questionnaire  in  its  totality. 

Description  of  the  Rating  Procedure 

After  the  questionnaire  items  were  assembled  by  Drs.  Huba  and  Bentler,  the  items  were 
sent  to  two  groups  of  individuals  for  rating.  The  first  group  --  hereafter  called  the  "consult- 
ants" --  consisted  of  the  10  individuals  who  had  participated  in  the  item  selection.  As  noted 
earlier,  these  individuals  were  Drs.  Peter  M.  Bentler,  Richard  R.  Clayton,  Marvin  D.  Dunnette, 
George  J.  Huba,  Lloyd  D.  Johnston,  Reese  T.  Jones,  Denise  B.  Kandel,  Howard  B.  Kaplan, 
Karolynn  Siegel,  and  Gene  M.  Smith.  The  second  group  --  hereafter  called  the  "panel"  --con- 
sisted of  four  individuals  who  had  not  participated  in  the  item  selection  and  furthermore  who 
had  not  contributed  any  of  the  items.  This  group  of  four  consisted  of  Drs.  Shirley  L.  Jessor, 
William  H.  McGlothlin,  Robert  J.  Pandina,  and  Bernard  Segal.  Each  of  the  four  consultants  had 
extensive  experience  in  conducting  questionnaire  or  survey  research  on  drug  use  with  groups 
of  young  adults  or  adolescents. 

In  the  consultant  group,  by  training,  five  of  the  individuals  were  psychologists,  four 
were  sociologists,  and  one  was  a physician.  In  the  panel,  all  four  participants  had  been 
trained  as  psychologists.  Among  the  nine  psychologists  in  the  total  group,  specialties  of 
methodology,  personality  assessment,  social,  industrial,  and  clinical  psychology  were  repre- 
sented . 

The  items  submitted  by  the  consultants  were  assembled  into  the  master  questionnaire  by 
Drs.  Huba  and  Bentler.  The  form  sent  to  the  consultants  and  panel  members  consisted  of  that 
shown  in  the  previous  section  (chapter  1).  The  only  modification  made  for  the  rating  process 
was  to  place  a small  space  for  recording  responses  next  to  the  overall  item  number.  The 
questionnaires  were  mailed  to  the  consultants  and  panel  members  at  the  same  time  with  the 
following  instructions: 


INSTRUCTIONS  FOR  RATING  VALUE  OF  ITEMS 

Items  dealing  with  the  negative  and  positive  consequences  of  marijuana  use  may 
be  relevant  to  research  for  many  reasons.  Most  obviously,  the  content  of  an 
item  may  deal  with  a specific  consequence  (whether  on  physical  health,  psych- 
ological or  social  functioning,  etc.)  that  is  either  likely  to  occur  frequently,  or 
to  occur  rarely  but  have  great  significance.  Alternatively,  an  item  may  be 
crucial  not  because  it  focuses  on  consequences  directly,  but  rather  because  it 
assesses  an  important  control  variable  that  is  essential  to  know  about  in  inter- 
preting any  potentially  observed  consequences.  Finally,  an  item  may  serve  as  a 
predictor  of  certain  consequences . Some  items  may  serve  several  functions . In- 
herently, then,  research  on  consequences  of  drug  use  is  multidimensional.  A 
complete  set  of  ratings  would  reflect  this  multidimensionality,  but  we  feel  that 
your  rating  task  should  be  more  manageable. 

If  you  were  conducting  research  on  consequences  of  marijuana  use,  or  if  you 
were  a consultant  to  a project  dealing  with  this  topic,  you  would  be  faced  with 
having  to  choose  items  for  your  study  on  the  basis  of  criteria  such  as  those 
mentioned  above.  Assume  that  your  choice  of  items  is  limited  to  those  that  are 
attached  with  this  mailing.  The  following  rating  procedure  is  designed  to 
determine  those  items  that  you  consider  absolutely  essential  to  include  in  such 
a study,  those  that  you  consider  necessary  but  not  as  essential,  etc.  In 
making  your  evaluation  of  the  necessity  of  including  a given  item  in  the  final 
study,  you  may  use  any  relevant  criteria  for  selection  of  items  that  you  like. 
Your  criteria  should  include  content  relevance,  as  outlined  above,  as  well  as 


50 


technical  adequacy  from  a psychometric  viewpoint,  ease  of  administration,  lack 
of  ambiguity,  etc.  Assume  that  the  final  set  of  items  is  administered  in  ques- 
tionnaire form  to  young  adults  with  at  least  a 10th  grade  educational  level.  No 
special  forms  like  "optical  scan"  are  necessarily  available. 

Specific  Instructions 

1 . Look  over  the  entire  questionnaire  to  get  a feel  of  the  type  of  content 
that  has  been  included.  You  might  make  notes  to  yourself  about  what  you  like, 
disUke,  etc.  This  overview  step  should  not  be  omitted! 

2.  Go  through  the  questionnaire  a second  time  to  locate  those  sections 
and  items  that  are  ABSOLUTELY  ESSENTIAL  to  include  in  even  the  very 
shortest  questionnaire.  Assume  that  this  shortest  questionnaire  has  5 minutes 
local  testing  time.  Write  the  number  "10"  next  to  each  such  item.  (You  might 
use  a red  pencil  here.) 

3.  Review  step  2.  Do  you  really  have  the  absolute  minimum  number  of 
10s?  Can  the  average  respondent  finish  the  task  in  5 minutes?  If  not,  change 
some  of  the  less  crucial  items  to  ratings  of  "9." 

\ 

4.  Go  through  the  questionnaire  again.  Find  those  VERY  NECESSARY 
items  that  would  add  another  5 minutes  of  testing  time.  Mark  these  items  "9" 
(possibly,  in  another  color  pencil  or  pen).  These  items  should  tap  important 
dimensions  well,  and  should  supplement  the  content  of  the  "10"  items  if 
possible . 

5.  Review  step  4.  Can  the  items  marked  "9"  really  be  finished  in  5 min- 
utes? If  not,  change  some  of  the  less  crucial  items  to  ratings  of  "8." 

6.  Proceed  in  cychcal  steps  in  accordance  with  the  above  instructions. 
Use  the  following  numbering  system  until  each  item  has  a single  number  at- 
tached to  it  (again,  for  visibihty,  you  might  use  different  colors  for  the  first 
few  highest  ratings); 


RATING  SCALE 


Rating 

Key  Words 

Testing  Time 

Interpretation 

10 

study 

ESSENTIAL 

5 min. 

Absolutely  necessary 

in  the  field 

to  any 

9 

VERY 

NECESSARY 

+5  min . (=10) 

Almost  essential  items 

8 

NECESSARY 

+5  min.  (=15) 

Items  tap  an  important 

dimension 

7 

VERY 

DESIRABLE 

+5  min.  (=20) 

Items  tap  a possibly 
dimension  well 

important 

6 

DESIRABLE 

+5  min.  (=25) 

Items  tap  a possibly 

important 

dimension 
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5 


ACCEPTABLE  +5  min.  (=30) 


Items  have  at  least  face  validity 


4 


OKAY 


Could  be  used  in  drug  studies 


3 


MARGINAL 


Might  be  useful  in  special  circum- 
stances 


2 


WORTHLESS 


No  special  value,  but  not  dan- 
gerous 


1 


AVOID 


Worthless  and  misleading.  Never 
use. 


In  summary,  note  that  the  ratings  from  10  to  5 should  be  somewhat  evenly  dis- 
tributed, at  least  with  respect  to  your  guess  as  to  the  testing  time  involved. 
You  may  find  the  cyclical  nature  of  the  ratings  to  be  difficult,  but  this  is  the 
only  way  to  be  sure  that  you  are  not  overlooking  important  content.  Ratings  of 
4 and  below  may  be  able  to  be  made  in  one  single  pass  when  the  best  items 
have  been  chosen,  but  we  doubt  that  a single  or  a few  passes  could  assure 
that  the  ratings  of  5-10  have  the  distributions  that  we  would  like  you  to 
impose. 


In  summary,  it  should  be  noted  that  we  asked  the  raters  to  make  a unidimensional  judg- 
ment about  the  quality  of  the  items.  The  unidimensional  rating  was  selected  after  much  deli- 
beration by  the  UCLA  staff.  Our  original  design  of  the  rating  task  included  five  separate 
judgments  for  each  item  so  that  we  could  disentangle  facets  of  content,  usability,  and  current 
format.  After  careful  examination  of  the  cognitive  demands  of  the  task,  it  was  decided  that 
the  different  judgments  would  potentially  be  so  highly  correlated  in  a positive  direction  that  we 
would  be  able  to  argue  that  there  was  a general  evaluation  factor  in  the  ratings.  Conse- 
quently, in  order  to  lessen  cognitive  overload  for  the  raters  and  thus  presumably  increase  the  | 
overall  validity  of  the  task,  we  made  the  judgment  task  unidimensional. 

Statistical  Analysis 

After  the  ratings  were  received  in  Los  Angeles,  they  were  prepared  for  computer  pro- 
cessing. All  the  statistical  analyses  reported  upon  here  were  conducted  using  various  pro- j 
grams  from  the  Biomedical  Computer  Programs,  P-Series  (BMDP;  Dixon  and  Brown,  1979) 
statistical  package  or  the  SPSS  package  (Nie  et  al.  1975).  All  ratings  were  handled  anony- 
mously. 

The  first  set  of  statistical  analyses  sought  to  determine  how  individual  judges  distributed 
their  ratings  of  the  items.  Such  an  analysis  determines  the  overall  favorability  of  the  rater  to 
the  item  set  and  determines  whether  there  are  differences  between  judges  in  the  extent  to 
which  they  find  the  items  acceptable.  Table  1 presents  the  number  of  responses  for  each  of 
the  categories  1 through  10  given  by  each  consultant  and  panel  member.  As  will  be  remem- 
bered, rating  category  "1"  was  for  items  which  should  be  avoided.  The  first  judge,  who  was 
one  of  the  consultants,  thought  that  17  (4  percent)  of  the  473  items  should  be  avoided.  In 
contrast,  that  judge  thought  that  70  (15  percent)  of  the  items  fit  into  the  "essential"  or  "10" 
category.  The  mean  rating  for  the  472  of  the  473  items  that  were  rated  by  Judge  1 was  6.46 
and  the  standard  deviation  for  the  ratings  was  2.49.  The  fourteenth  rater  thought  that  none 
of  the  items  belonged  in  the  "1"  category  and  that  31  (7  percent)  of  the  items  belonged  in  the; 
"10"  category.  Over  all  462  of  the  items  rated,  the  judge  assigned  a mean  rating  of  4.93  with 
a standard  deviation  of  2.18. 

The  reader  should  note  that  the  judges  are  listed  in  random  order  in  table  1.  Alpha- 
betization was  not  used. 
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Table  1.  Response  category  frequencies  by  rater 


Codes 


Rater 

Group 

Mean 

S.D. 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

Blank 

1 

consultant 

6.46 

2.49 

17 

(4%) 

7 

(1%) 

41 

(9%) 

55 

(12%) 

46 

(10%) 

63 

(13%) 

63 

(13%) 

63 

(13%) 

47 

(10%) 

70 

(15%) 

1 

(1%) 

2 

panel 

4.69 

2.05 

15 

(3%) 

26 

(6%) 

90 

(19%) 

107 

(22%) 

138 

(29%) 

28 

(6%) 

18 

(4%) 

10 

(2%) 

9 

(2%) 

30 

(6%) 

2 

(1%) 

3 

consultant 

5.64 

2.32 

3 

(1%) 

23 

(5%) 

17 

(4%) 

188 

(40%) 

40 

(8%) 

39 

(8%) 

41 

(9%) 

41 

(9%) 

40 

(8%) 

40 

(8%) 

1 

(1%) 

4 

consultant 

7.15 

2.69 

9 

(2%) 

48 

(10%) 

17 

(4%) 

14 

(3%) 

23 

(5%) 

30 

(6%) 

74 

(16%) 

71 

(15%) 

75 

(16%) 

110 

(23%) 

2 

(1%) 

5 

consultant 

7.48 

1 .93 

0 

(0%) 

1 

(1%) 

5 

(1%) 

19 

(4%) 

71 

(15%) 

64 

(14%) 

65 

(14%) 

75 

(16%) 

76 

(16%) 

96 

(20%) 

1 

(1%) 

6 

consultant 

4.90 

2.77 

54 

(11%) 

95 

(20%) 

22 

(5%) 

35 

(7%) 

68 

(14%) 

50 

(11%) 

46 

(10%) 

56 

(12%) 

13 

(3%) 

34 

(7%) 

0 

(0%) 

7 

consultant 

7.31 

1 .62 

0 

(0%) 

0 

(0%) 

0 

(0%) 

0 

(0%) 

96 

(20%) 

55 

(12%) 

106 

(22%) 

90 

(19%) 

74 

(16%) 

51 

(11%) 

1 

(1%) 

8 

consultant 

8.42 

1.66 

0 

(0%) 

2 

(1%) 

3 

(1%) 

2 

(1%) 

13 

(3%) 

43 

(9%) 

86 

(18%) 

69 

(15%) 

61 

(13%) 

192 

(41%) 

2 

(1%) 

9 

consultant 

7.96 

1.60 

0 

(0%) 

0 

(0%) 

0 

(0%) 

0 

(0%) 

52 

(11%) 

35 

(7%) 

94 

(20%) 

94 

(20%) 

95 

(20%) 

103 

(22%) 

0 

(0%) 

10 

consultant 

6.09 

2.69 

13 

(3%) 

52 

(11%) 

26 

(5%) 

50 

(11%) 

50 

(11%) 

78 

(16%) 

58 

(12%) 

42 

(9%) 

16 

(3%) 

88 

(19%) 

0 

(0%) 

11 

panel 

5.98 

2.36 

4 

(1%) 

4 

(1%) 

62 

(13%) 

110 

(23%) 

47 

(10%) 

48 

(10%) 

55 

(12%) 

44 

(9%) 

52 

(11%) 

45 

(10%) 

2 

(1%) 

12 

panel 

5.78 

3.05 

29 

(6%) 

90 

(19%) 

44 

(9%) 

10 

(2%) 

22 

(5%) 

52 

(11%) 

65 

(14%) 

48 

(10%) 

39 

(8%) 

74 

(16%) 

0 

(0%) 

13 

consultant 

5.23 

3.08 

49 

(10%) 

87 

(19%) 

44 

(9%) 

42 

(9%) 

34 

(7%) 

41 

(9%) 

44 

(9%) 

30 

(6%) 

35 

(7%) 

67 

(14%) 

0 

(0%) 

14 

panel 

4.93 

2.18 

0 

(0%) 

34 

(7%) 

40 

(8%) 

232 

(49%) 

28 

(6%) 

27 

(6%) 

21 

(4%) 

23 

(5%) 

26 

(5%) 

31 

(7%) 

11 

(2%) 
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Overall,  table  1 shows  that  the  different  judges  did  rate  the  items  with  different  degrees 
of  "halo"  or  positive  evaluation.  Simply  ranking  the  mean  ratings  from  largest  to  smallest,  it 
may  be  seen  that  Judge  8 thought,  on  the  average,  that  the  items  were  excellent.  Judge  2, 
on  the  average,  was  the  most  critical  of  the  items.  The  judges,  ranked  in  order  of  their 
"favorableness  to  the  item  set"  are  judges  8,  9,  5,  7,  4,  1,  10,  11,  12,  3,  13,  14,  6,  and  2. 
Of  course,  the  average  rating  of  quality  does  not  incorporate  the  variability  in  the  ratings  of 
the  judge.  We  can  also  derive  a favorableness  index  for  each  judge  by  subtracting  the  scale 
midpoint  of  5.5  from  the  average  rating  and  dividing  the  difference  by  the  standard  deviation 
of  the  ratings.  For  the  14  judges  respectively,  the  favorableness  rating  (and  its  rank  among 
the  judges)  is  .39  (6),  -.40  (14),  .06  (10),  .61  (5),  1.03  (4),  -.22  (12),  1.12  (3),  1.76  (1), 
1.54  (2),  .22  (7),  .20  (8),  .09  (9),  -.09  (11),  -.26  (13).  The  ranks  for  the  mean  ratings  of 
the  judges  and  the  favorableness  index  are  virtually  indistinguishable  with  the  Spearman  rank 
order  correlation  between  the  two  indices  of  perceived  acceptability  of  the  items  being  .991. 
Clearly  the  two  indices  provide  highly  related  rankings  of  the  judges.  It  is  quite  interesting 
to  note,  by  the  way,  that  the  favorableness  rating  for  a judge  is  greater  than  zero  10  out  of 
14  times.  In  general,  the  judges  were  using  response  scales  for  their  ratings  which  were 
skewed  toward  positive  ratings  and  found  the  items  acceptable. 

Rater  reliability 

The  first  and  fundamental  issue  in  a rating  task  such  as  the  present  one  is  to  determine 
the  extent  to  which  the  different  raters  agreed  with  one  another  about  the  quality  of  the 
items.  While  there  are  many  ways  of  making  such  an  assessment  including  the  calculation  of 
various  intraclass  correlation  coefficients,  we  sought  to  make  the  determination  using  statistics 
with  easy  intuitive  interpretations  which  would  also  allow  us  to  examine  whether  there  were 
clusters  of  judges  in  the  rating  task. 

The  first  reliability-like  analysis  we  conducted  was  to  intercorrelate  the  ratings  of  the 
judges  on  the  473  items  with  the  items  being  the  unit  of  analysis  and  the  "judges"  being  the 
"variables."  That  is,  we  found  the  14  by  14  correlation  matrix  of  judges  using  the  ratings  on 
the  items  as  observations.  These  correlations  tell  us  how  linearly  related  the  profile  of  scores 
given  by  pairs  of  judges  were.  The  product-moment  correlations  (r)  between  pairs  of  judges 
are  given  in  the  upper  triangular  part  of  table  2.  Since  some  readers  may  wish  to  examine 
nonparametric  correlations  among  the  judges,  Spearman  rank-order  correlation  coefficients  (p) 
are  given  in  the  lower  triangular  part  of  table  2.  Our  further  analyses  and  interpretations 
will  be  based  upon  the  product-moment  coefficients  in  the  upper  triangle.  It  may  be  noted, 
however,  that  the  values  of  the  product-moment  and  rank-order  coefficients  are  about  the  same 
numerically. 

As  can  be  seen  in  table  2,  there  are  pairs  of  judges  whose  ratings  correlate  quite  highly 
with  one  another  and  other  pairs  of  judges  whose  ratings  correlate  rather  poorly  with  even  a 
few  negative  coefficients  being  observed.  For  example,  the  overall  profile  of  ratings  of  judge 
13  correlates  .67  with  the  profile  of  ratings  for  judge  6.  On  the  other  hand,  the  profile  of 
ratings  for  judge  13  is  negatively  correlated  with  the  profile  for  judge  1 (r  = -.165).  In 
general  we  interpret  the  results  of  table  2 to  indicate  that  the  consensus  of  the  judges  was 
fairly  low  although  an  average  composite  would  have  reasonable  reliability  since  the  mean 
among-judge  correlation  is  .20.  It  seems  possible  to  identify  certain  clusters  of  judges  from 
the  similarity  ratings  given  in  table  2,  but  it  is  not  clear  that  a single,  general  dimension 
would  serve  to  explain  the  majority  of  the  observed  similarity  and  dissimilarity. 

One  approach  that  we  might  make  to  analyzing  the  matrix  of  judge  intercorrelations  is  to 
determine  factors  or  dimensions  of  judges.  In  table  3 we  present  such  "Q-factors"  formed  by 
calculating  1 through  4 principal  components  from  the  product-moment  correlation  matrix  of 
table  2 and  rotating  the  components  orthogonally  using  the  varimax  method.  The  results  of  ^ 
such  analyses  are  dimensions  which  represent  factors  of  judges.  Several  observations  can  be  I 
made  from  the  findings  portrayed  in  table  3.  First,  in  examining  the  unidimensional  solution  it 
may  be  seen  that  when  it  is  assumed  that  there  is  a single  dimension  of  judge  similarity  much 
of  the  variance  is  left  unexplained.  The  first  principal  component  of  the  correlations  of  table 
2 served  to  explain  only  about  29  percent  of  the  total  variance.  The  three-dimensional  solution 
we  prefer  explains  about  54  percent  of  the  total  variance. 
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Table  2.  Rater  by  rater  product-moment  and  Spearman  rank  correlation  coefficients  for  all  items 
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the  lower  left  triangle  are  the  Spearman  rank  correlation  coefficients. 


In  the  three-factor  solution,  judges  5,  6,  7,  9,  10,  and  13  all  have  loadings  in  excess  of 

.5  on  the  first  dimension  of  similarity.  Judges  2,  4,  9,  11,  and  14  have  loadings  in  excess  of  i 

.5  on  the  second  dimension.  Note  that  the  judges  on  the  second  dimension  are,  by  and  large, 

the  outside  panel  members.  Judges  1 and  12  are  contrasted  on  the  third  dimension.  In  the  i 

three-dimensional  solution,  only  judges  3 and  8 do  not  have  loading  in  excess  of  .5  on  any  j 
dimension  and  only  judge  9 has  a loading  on  more  than  one  dimension.  s 

! 

If  we  consider  the  two  dimensional  solution,  it  can  be  seen  that  judges  5,  6,  7,  10,  12,  | 
and  13  form  the  first  dimension  or  cluster  while  judges  1,  2,  3,  4,  11,  and  14  form  the  second 
cluster.  Judge  9 loads  on  both  dimensions.  Thus,  it  appears  that  whether  we  determine  two 
or  three  dimensions  from  the  matrix  of  judge  similarities  shown  in  table  2 we  are  left  with  the  ' 
conclusion  that  there  are  two  large  clusters  of  judges,  with  the  possibility  of  a third  two-  ! 
person  contrast.  This  conclusion  suggests  that  several  considerations  should  be  taken  into  ac- 
count in  interpreting  the  results  of  further  analyses  which  seek  to  differentiate  among  the  ■ 
individual  items. 

First,  it  should  be  recognized  that  the  individual  item  ratings  will  be  something  of  a 
rough  sum  of  ratings  from  two  distinctly  different  types  of  raters.  When  we  consider  a single 
number  for  an  item  we  are  combining  the  judgments  issued  by  the  two  different  groups. 
Second,  because  the  individual  item  ratings  contain  more  than  one  source  of  variance,  it  is  | 
quite  likely  that  the  individual  item  variances  will  be  relatively  large.  Since  the  judges  do  not 
all  rate  the  items  in  the  same  way,  the  summation  of  several  types  of  rating  will  lead  to  large 
individual  item  standard  deviations. 

Third,  and  most  importantly,  since  the  individual  ratings  are  quite  variable,  due  to  the 
fact  that  different  types  of  judges  are  providing  evaluations,  the  individual  user  will  have  to 
exercise  large  amounts  of  personal  judgment  in  selecting  the  items.  It  is  likely  that  an  in- 
dividual user  will  be  relatively  more  aligned  with  one  of  the  types  of  judge  present,  but  un- 
aligned with  at  least  one  of  the  other  groups.  The  concerns  of  the  groups  with  which  the 
investigation  is  not  aligned  may  be  generally  irrelevant  to  the  type  of  research  being  designed. 
The  general  lack  of  consensus  among  the  ratings  argues  that  the  individual  user  will  have  to  i 
exercise  at  least  moderate  amounts  of  individual  professional  judgment  in  weighting  and  using 
the  ratings  for  the  items  compiled  here. 

Thus  far,  we  have  considered  reliability  statistics  for  the  total  set  of  items.  As  noted 
earlier,  the  items  can  be  loosely  clustered  into  13  domains.  We  may  ask  how  consistent  the  j 
judges  were  with  one  another  in  each  of  the  13  domains.  j 

] 

, Before  beginning  the  examination  of  the  within-domain  consistency  issue,  it  should  be  | 
noted  that  some  judges  rated  all  items  in  a given  domain  with  the  same  value.  This  meant  that 
there  was  no  variance  in  the  ratings.  When  this  occured  we  were  unable  to  use  their  ratings  : 
for  the  statistical  analyses  reported  below  and  in  tables  4 and  5. 

For  each  of  the  domains  we  calculated  the  14-by-14  correlation  matrix  among  judges  (or  a 
smaller  matrix  when  one  or  more  judges  did  not  vary  in  the  ratings  within  the  domain).  The 
correlation  matrix  for  each  of  the  13  domains  is  summarized  in  table  4.  In  that  table  we  show  | 
the  average  correlation  among  raters.  This  average  is  an  algebraic  one.  Negative  correlations 
tend  to  cancel  positive  ones,  which  therefore  provides  a "good"  single  number  summary  for 
assessing  comparative  reliability.  The  average  was  calculated  using  the  Fisher  r-to-z  normali- 
zation and  denormalization  method.  For  each  of  the  domains  we  also  show  the  percentage  of 
the  available  correlations  falling  within  certain  broad  categories.  For  instance,  we  can  examine  . 
the  statistics  for  the  first  domain  of  Accidents  and  Hospitalization.  Thirteen  raters  had  vari- 
ance in  their  ratings.  The  percentage  of  the  78  correlations  which  fall  in  the  range  .75  to 
1.00  is  15.4.  The  average  correlation  among  judges  is  .374. 

In  table  5 we  present  an  alternate  way  of  describing  the  amount  of  correlation  among  the 
different  judges  and  the  pattern  present.  In  table  5 we  show  the  loadings  of  each  judge  on 
the  first  principal  component  calculated  from  the  product-moment  correlations  among  judges  for  ' 
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Table  3.  Orthogonally  rotated  principal  components  analyses  using  1 to  4 dimensions 

for  all  raters  on  all  items 


One  Two  Three  Four 

factor  factors  factors  factors 


Rater 

Group 

1 

1 

II 

1 

II 

III 

1 

II 

III 

IV 

1 

consultant 

.054 

-.259 

.468 

-.068 

.196 

.734 

-.056 

.229 

.773 

-.077 

2 

panel 

.386 

-.048 

.745 

-.111 

.798 

.041 

-.119 

.795 

.051 

-.177 

3 

consultant 

.402 

.190 

.431 

.304 

.273 

.429 

.296 

.302 

.374 

.193 

4 

consultant 

.433 

.078 

.646 

.021 

.699 

.010 

.007 

.698 

-.016 

-.037 

5 

consultant 

.505 

.664 

-.070 

.750 

-.162 

.132 

.751 

-.137 

.108 

.121 

6 

consultant 

.687 

.803 

.048 

.764 

.119  - 

.223 

.758 

.124 

-.243 

.008 

7 

consultant 

.746 

.703 

.296 

.648 

. 375  - 

.180 

.641 

.378 

-.192 

-.061 

8 

consultant 

.031 

-.077 

.165 

.006 

.050 

.301 

-.038 

.074 

.052 

.911 

9 

consultant 

.715 

.478 

.566 

.502 

.526 

.165 

.485 

.546 

.093 

.167 

10 

consultant 

.631 

.567 

.289 

.615 

.232 

.139 

.628 

.249 

.209 

-.284 

11 

panel 

.570 

.219 

.684 

.180 

.716 

.052 

.154 

.723 

-.035 

.176 

12 

panel 

.369 

.465 

-.023 

.241 

.282  - 

.733 

.227 

.249 

-.750 

-.099 

13 

consultant 

.732 

.906 

-.022 

.898 

.015  - 

.169 

.896 

.026 

-.176 

-.014 

14 

panel 

.552 

.246 

.614 

.255 

.586 

.170 

.241 

.600 

.119 

.089 

Accountable 

variance 

28.55% 

24.24% 

19.63% 

23.36% 

19.19%  11 

.13% 

23.01% 

19.65%  10.79% 

7.73% 
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Table  4.  Summary  of  rater  by  rater  correlations  for  each  domain 


c 


0)  o 


O)  4_> 

CM 

03 

00 

O 

ID 

ID 

ID 

— 

ID 

CM 

ID 

00 

o 

ID 

CM 

ID 

CM 

CO 

ID 

CO 

CO 

03  ^ 
> U 

CO 

O 

00 

r- 

O 

t“ 

r— 

00 

O 

O 

o 

< O 

u 

1 

if)  o 

ID 

ID 

00 

O 

CD 

ID 

O 

o 

o 

• 

ID 

r— 

CD 

o 

00 

LC3 

O 

o 

r- 

O Tf 

ID 

03 

O 

CD 

ID 

o 

CM 

o 

ID 

O 

CD 

CD 

CD 

T— 

CD 

CD 

o 

CM 

o 

CM 

r“ 

r- 

r- 

1 

in  (X) 

ID 

o 

00 

CT3 

o 

ID 

CM 

ID 

ID 

C33 

<o 

CM  'O- 

c 

O 

CM 

03 

00 

O 

CM 

CD 

r— 

ID 

CO 

CD 

o 

CM 

CM 

00 

CM 

CM 

CM 

CM 

CM 

00 

T— 

T— 

+-> 

fO 

1 

<u 

O 

r- 

CM 

00 

o 

ID 

O 

CM 

CO 

D 

ID 

ID 

CO 

s. 

O CM 

s. 

00 

O 

o 

00 

CO 

ID 

CO 

CD 

CM 

o 

u 

CM 

CM 

CM 

CM 

CM 

00 

CM 

00 

CM 

00 

CM 

ID 

q- 

o 

1 

^ o 

00 

CO 

00 

CO 

03 

CD 

CD 

00 

r“ 

CD 

00 

CO 

d) 

CM  O 

O) 

CM 

00 

00 

ID 

CM 

r“ 

ID 

00 

03 

1 

r— 

00 

r“ 

r“ 

00 

r- 

CM 

CM 

CM 

00 

CM 

c 

03 

1 

O 

<03  ID 

r— 

CD 

00 

03 

h' 

o 

CO 

CM 

o 

L. 

^ CM 

0) 

ID 

CM 

CM 

00 

03 

CM 

CD 

CD 

CM 

o' 

CM 

CM 

o 

CL 

1 1 

r- 

1 

^ o 

CD 

O 

O 

00 

00 

00 

O 

CD 

o 

O 

o 

ID 

1 1 

CM 

00 

O 

CD 

00 

00 

r“ 

00 

00 

o 

CD 

CD 

CD 

1 

o in 

o 

O 

o 

O 

CM 

r“ 

o 

o 

O 

O 

o 

O 

O 

o 

1 1 

O 

o 

O 

CM 

o 

CD 

O 

O 

CD 

O 

O 

o 

in 

o 

c 

o 

s_ 

03 

4-» 

n 

0) 

E 

D 

0) 

L- 

L. 

Z 

o 

o 

CDOOlD^t- 
(S>  (T>  (T> 


00  03  m 

CD  in 


r-  00  LD  CD 
cn  ^ fo 


§" 


CM  00 


00  CM 


00  O 03 


(/) 

c 

o 


Xi  c 

•M 

u 

03 

a) 

x: 

+j 

c _o 

0) 

03 

(T3 

c 

1- 

03 

c 

x: 

‘•M 

03 

03 

S 2 

cu 

L 

O 

c 

03 

"cD 

U 

0) 

.^’5. 

3 

<T3 

’(/3 

0) 

O (/) 

m 

> 

‘C 

L 

o o 

’o3 

03 

03 

sz 

< 

< SI 

—I 

Q 

E 

CL 

Xi 

c 

(/) 

c 

M- 

O 

to 

+-> 

u 

d) 

to 

+-> 

u 

CD 

o 

to 

4-> 

x: 

(4- 

0) 

4- 

*». 

w 

+-» 

o 

4-> 

d> 

U) 

(D 

4-» 

-M 

dJ 

u 

£ 

o 

03 

0) 

L 

d) 

a 

(0 

03 

c 

o 

ID 

03 

x: 

O) 

D 

L 

d) 

O) 

3 

L. 

03 

c 

o 



4-> 

u 

1d 

■D 

L, 

-D 

s_ 

u 

c 

03 

03 

o 

G) 

’u 

O 

D 

03 

o 

10 

'u 

o 

03 

to 

u> 

E 

£ 

<_ 

C7 

TD 

L 

to 

13) 

4-> 

o 

d) 

d) 

■ — 

C 

(D 

o 

3 

03 

o 

1 

4-> 

V) 

ID 

Q. 

to 

.c 

1 

O) 

"O 

u 

O) 

d) 

u 

S- 

0) 

3 

s_ 

CD 

d) 

1 3 

> 

3 

> 

0 

c 

L 

ID 

LU 

to 

l- 

w 

0 

Q 

ir 

CD 

CL 

■a 

□ 

a. 

cn 

-J 

58 


All  items  14  91  0.0  0.0  1.1  14.3  48.4  33.0  3.3  0.0  .202 
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that  domain.  To  the  extent  that  all  the  judges  load  with  a positive  weight  on  the  dimension  we 
can  infer  that  there  is  consensus  in  how  the  items  within  the  domain  rank.  The  lack  of  a 
general  dimension  may  be  taken  as  an  indication  that  there  was  a lack  of  consensus  within  the 
domain.  A dimension  with  many  positive  and  negative  weights  indicates  an  active  disagreement 
between  judges.  Note  that  not  all  judges  are  used  in  each  analysis  since  we  had  to  eliminate 
those  individuals  whose  ratings  had  no  variance. 

If  we  examine  table  5 in  detail  it  can  be  seen  that  there  is  clearly  more  consensus  for 
certain  domains.  The  domains  of  Accidents  & Hospitalization,  Deviance,  Marijuana  Reactions, 
and  Life  Satisfaction  seem  rather  consistently  rated.  Interestingly  there  seems  to  be  little 
consensus,  or  at  least  a dichotomy  of  opinion,  on  the  usefulness  of  Physical  Health  and  Psy- 
chological Health  items.  Other  domains  such  as  Drug  Use  were  rated  with  moderate  consistency 

Statistics  for  each  item 

Table  6 presents  statistical  summaries  of  the  14  ratings  on  each  of  the  473  items.  The 
first  column  of  table  6 presents  the  item  number.  This  number  corresponds  to  the  master  item 
number  given  on  the  questionaires . The  numbers  are  sequential.  The  second  column  lists  the 
number  of  raters  for  whom  valid  data  are  available.  In  almost  all  cases  every  judge  rated  the 
item.  The  third  column  presents  the  mean  rating  across  all  available  judges.  This  is  the 
simple  arithmetic  average  of  the  ratings.  The  fourth  column  presents  the  standard  deviation 
of  the  ratings.  The  standard  deviation  is  an  index  of  the  variability  of  the  ratings.  The 
fifth  column  presents  the  biweighted  mean.  We  believe  that  this  statistic  is  the  single  best 
summary  of  the  overall  ratings.  The  biweighted  mean  is  a weighted  average  which  tends  to 
count  most  heavily  those  judgments  in  the  middle  of  the  distribution  and  weights  least  heavily 
those  judgments  which  are  highly  at  variance  with  the  other  ratings.  That  is,  the  biweighted 
means  eliminate  (in  a statistically  rigorous  way),  one  or  two  judgments  which  are  widely  dis- 
crepant from  those  held  by  the  rest  of  the  panel.  The  biweighted  mean  is  discussed  in  great 
detail  by  Mosteller  and  Tukey  (1977,  chapters  10,  14).  Mosteller  and  Tukey  recommend  the 
statistic  as  a central  tendency  measure  which  is  robust  both  in  efficiency  and  validity  for 
"long-tailed"  data  which  might  have  one  or  two  outliers. 

The  sixth  column  of  table  6 presents  the  median  rating  for  each  of  the  items.  In  gen- 
eral, the  median  is  quite  similar  to  the  biweighted  mean,  but  the  biweighted  mean  will  tend  to 
be  a little  more  efficient  in  using  the  total  information  in  the  ratings.  Either  the  biweighted 
mean  or  the  median  is  a good  measure  for  understanding  the  central  tendency  in  the  ratings  of 
item  quality.  The  seventh  column  presents  the  minimum  and  maximum  rating  for  the  item. 
These  are  the  lowest  and  highest  ratings  given  by  at  least  one  judge.  The  8th  through  10th 
columns  present  the  number  of  raters  who  gave  the  item  a rating  in  the  1-3  (Poor),  4-7 
(Average),  and  8-10  (Excellent)  ranges.  So  as  to  show  the  differences  between  the  panel  and 
consultant  raters,  the  11th  column  presents  the  mean  rating  for  the  panel  while  the  12th 
column  shows  how  many  panel  members  rated  the  item.  Column  13  presents  the  mean  rating 
for  the  consultants  and  column  14  gives  the  number  of  consultant  raters  for  the  item.  Finally, 
the  15th  column  gives  a t-ratio  for  the  difference  between  the  panel  and  consultant  ratings. 
The  t-ratio  is  the  Behrens-Fisher  statistic  which  is  a t-test-like  procedure  which  does  not 
assume  that  the  standard  deviations  within  the  groups  are  equal.  The  Behrens-Fisher  statistic 
uses  the  Satterthwaite  approximation  for  the  degrees  of  freedom. 

Linear  comparisons  of  the  panel  and  consultant  ratings 

Since  the  item  mean  comparisons  presented  in  table  6 clearly  indicated  discrepancies 
between  the  panel  and  consultant  ratings  regarding  a number  of  the  items,  a logical  step  was 
to  determine  whether  any  systematic  patterns  or  trends  were  evident.  For  all  473  items  there 
was  a sizeable  product-moment  correlation  of  .47  between  the  panel  mean  ratings  and  the  con- 
sultant mean  ratings.  This  indicates  that  about  22  percent  of  the  variance  between  mean 
ratings  given  by  the  panel  and  mean  ratings  given  by  the  consultants  is  accountable  using  a 
linear  model. 
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Table  6.  Rating  statistics  for  each  item 
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Table  6.  Rating  statistics  for  each  item  Continued 
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Table  6.  Rating  statistics  for  each  item  Continued 


c 

<Q 

3 

(A 

c 

o 

u 


0) 

c 

ra 

CL 


V) 

O) 

c 

'•M 

n 

L. 

O) 

c 

> 

O) 

d 

z 


o 

z 


o 

z 


<- 

o 

o 

a 


•o 

0) 

■M 

O) 

'q> 

I 


c 

ro 

■M 

t/) 


o 

OJ 

LO 

(O 

r* 

r~ 

CM 

CM 

o 

CM 

CD 

* 

00 

in 

(£> 

f'- 

00 

O) 

r>> 

CM 

in 

CM 

r- 

r~ 

CO 

in 

CD 

o 

d 

d 

o 

1 

d 

r~ 

r— 

d 

d 

d 

r~ 

d 

c> 

1 

CM 

CM 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

r~ 

r” 

r“ 

r- 

r“ 

r“ 

r“ 

r~ 

r” 

r“ 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

00 

r'- 

in 

00 

CO 

r' 

o> 

CO 

CM 

CD 

o> 

(d 

(O 

00 

00 

d 

d 

CD 

CD 

d 

d 

d 

'I- 

'O' 

o 

o 

o 

lO 

o 

LO 

o 

o 

in 

in 

in 

in 

in 

o 

in 

in 

o 

o 

o 

CM 

o 

in 

m 

in 

CM  i 

id 

00 

r>^ 

00 

m 

d 

d 

d 

d 

d 

d 

d 

d 

CO 

CO  1 

1 

00 

CM 

00 

CD 

in 

CD 

CO 

00 

CD 

r>- 

CD 

in 

1 

00 

CJ) 

CD 

in 

CD 

00 

m 

CD 

CD 

00 

CD 

00 

CO 

1 

'D- 

r- 

O 

o 

r~ 

^ — 

r~ 

CM 

rf 

CD 

X 

OJ 

z 

O 

o 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

O 

CD 

o 

o 

r" 

r— 

r~ 

fT" 

r" 

r* 

r*“ 

T“ 

r“ 

r“ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

c 

i 

CM 

r* 

f'* 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

c 

CD 

O 

o 

o 

o 

O 

O 

O 

O 

O 

O 

O 

O 

O 

O 

O 

o 

TJ 

O 

o 

m 

o 

in 

in 

O 

o 

O 

in 

O 

in 

m 

in 

O 

in 

0) 

m. 

d 

r>^ 

d 

d 

d 

00 

d 

d 

CD 

d 

c 

o 

o 

o 

00 

CD 

00 

o 

in 

00 

o 

CD 

nj 

0) 

in 

m 

in 

CM 

T“ 

m 

00 

CD 

in 

CD 

CD 

o 

00 

CD 

CM 

E 

in 

d 

d 

d 

d 

CD 

d 

d 

d 

d 

CD 

d 

d 

in 

m 

m 

o 

CM 

CM 

m 

in 

CD 

o 

r— 

in 

CD 

00 

CM 

dev 

CM 

CD 

CD 

in 

CD 

in 

CD 

00 

00 

CD 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

c\i 

CM 

CM 

CM 

CM 

c 

O 

CD 

o 

O 

CD 

00 

O 

CD 

CD 

CD 

O 

CD 

<0 

0) 

in 

CM 

m 

r— 

o 

in 

CD 

o 

00 

00 

o 

00 

O 

CM 

s 

d 

d 

d 

d 

</) 

d 

d 

d 

CD 

r>- 

CD 

CD 

d 

d 

CD 

in 

c 

o 

i/i 

s. 

0) 

'S' 

■t-l 

o 

(D 

(U 

r. 

X— 

r“ 

<D 

r— 

(TJ 

a: 

0) 

q: 

X 

(D 

6 

z 

00 

(D 

o 

c 

(D 

CM 

00 

in 

CD 

00 

CD 

o 

"5 

u 

r— 

CM 

in 

m 

in 

in 

in 

in 

in 

in 

in 

m 

CD 

(0 

CD 

CD 

E 

&. 

> 

0) 

(D 

x: 

s 

CL 

6i» 


Table  6.  Rating  statistics  for  each  item  Continued 


lA 

c 

<TJ 

"5 

(/) 

c 

o 

u 


(1) 

c 

OJ 

a. 


0 

(/) 

01 

c 


u 

U) 

c 

> 

O) 

d 

z 


* * * 


* 

* 

# 

* 

•X- 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

C\J 

Lf) 

rv 

CD 

|V 

O 

CD 

CD 

00 

CD 

r" 

D 

00 

o 

o 

00 

CM 

CM 

00 

o 

o 

00 

CM 

CM 

D 

D 

1 

CM 

CO 

CO 

CO 

CM 

00 

cn 

CM 

CM 

CD 

00 

rd 

4-» 

w 

O 

L. 

o 

O 

O 

o 

o 

O 

o 

o 

O 

o 

o 

o 

O 

O 

O 

O 

o 

o 

o; 

r“ 

r— 

r- 

r— 

r" 

T“ 

r- 

r— 

d 

z 

L. 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

C 

r* 

o 

o 

o 

CD 

ID 

00 

r- 

cn 

CD 

cn 

CD 

CM 

0) 

s 

00 

rd 

00 

00 

00 

00 

00* 

CD 

CO 

CD 

CD 

rd 

rd 

(/) 

L. 

o 

0) 

m 

d 

W 

03 

z 

1. 

LD 

m 

o 

o 

o 

CD 

LD 

o 

o 

D 

D 

D 

D 

D 

D 

D 

D 

D 

03 

lO 

o 

o 

C'- 

CM 

o 

D 

CM 

CM 

CM 

CM 

r>> 

a> 

S 

cd 

CO 

LD 

cn 

D 

D 

00 

CM 

CM 

CM 

"5 

u 

o 

X 

0) 

1 

00 

CD 

CD 

00 

M 

CD 

D 

CD 

D 

CD 

CD 

L. 

1 

m 

CD 

ID 

CD 

lD 

D 

D 

cn 

CM 

cn 

CD 

> 

s-x 

(. 

cn 

o 

1 

OJ 

CM 

CM 

CO 

CM 

cn 

D 

D 

CD 

rr 

o 

a 

X 

ID 

o 

O 

O 

O 

O 

o 

O 

o 

O 

o 

O 

O 

o 

O 

O 

CD 

CD 

CD 

r“ 

r-“ 

T— 

\ 

’Vs. 

\ 

Vs, 

Vs 

\ 

"Vs 

\ 

Vs 

Vs 

Vs 

\ 

\ 

\ 

Vs 

c 

CM 

cn 

00 

CO 

cn 

CO 

00 

CO 

T— 

D 

r“ 

r“ 

CM 

CM 

CM 

2 

c 

ID 

O 

o 

o 

o 

o 

o 

o 

o 

o 

O 

o 

o 

o 

o 

o 

O 

O 

CD 

■O 

LO 

lD 

o 

ID 

LD 

LD 

LD 

o 

o 

D 

o 

o 

D 

o 

o 

D 

O 

CD 

0) 

s 

CD* 

CD 

r- 

00 

00 

CD 

CD 

D 

CD 

D 

CD 

CD 

T3 

(U 

CT 

0) 

5 

c 

ID 

(V 

00 

00 

oo 

CO 

oo 

CO 

D 

CD 

CM 

CM 

CD 

cn 

CO 

00 

00 

00 

00 

CD 

00 

CD 

o 

OO 

CD 

D 

CM 

CD 

is 

E 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

LD 

D 

D 

D 

CD 

CD 

lD 

> 

CM 

00 

o 

LD 

oo 

r*. 

00 

cn 

r" 

00 

D 

CD 

CD 

C\J 

O) 

c 

rv 

CJ) 

CD 

00 

rv 

CD 

U) 

CD 

00 

CD 

O 

CD 

CD 

00 

D 

CO 

■O 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

00 

D 

00 

cn 

CM 

CM 

c 

ID 

0) 

CD 

00 

CD 

CD 

CD 

05 

CD 

O 

r>. 

O 

CD 

'a* 

o 

CD 

00 

00 

CO 

CO 

00 

00 

CO 

ID 

CM 

D 

O 

OO 

CD 

fv 

D 

CM 

cn 

E 

CD 

CO 

CD* 

CD 

CD 

CD 

CD* 

|V 

r>- 

CD 

CD 

D 

D 

D 

D 

CD 

CD 

D 

V) 

o 

&_ 

0) 

'!3‘ 

d 

'03 

r* 

r— 

T— 

T— 

t— 

T— 

t— 

z 

cc 

d 

z 

cn 

CD 

CD 

00 

CD 

o 

r* 

CM 

cn 

D 

CD 

fv 

00 

O) 

o 

E 

0) 

CO 

CO 

CD 

CD 

CD 

CD 

CD 

fv 

r>- 

p'- 

r>- 

rv 

rv 

fv 

fv 

00 

65 


Table  6.  Rating  statistics  for  each  item  Continued 


(/) 


c 

(T3 


3 

W 

c 

o 

u 


0) 

c 

(D 

Q. 


O 

V) 

O) 

£ 

’+-> 

nj 

S- 

O) 

c 

■> 

O) 

d 

z 


o 

d 

z 


o 

d 

z 


<u 

o 

X 

<D 


S- 

0) 

> 

<TJ 


i. 

O 

o 

a 


T3 

0) 

+-> 

O) 

'(1) 

I 

CO 


c 

OJ 

4-> 

to 


o 

o 

z 


T3 

I 

■!-> 


5_ 

(U 

4- > 
(0 

5- 


c 

fO 

(U 

E 


in 

<u 

+-> 

OJ 

L. 


O 

I 

00 


I 


00 


X 

IT3 


c 

(D 


T> 

(U 


C 

03 

03 

£ 


> 

0) 

T3 


</) 

t- 

03 

■fJ 

03 

QO 


E 

03 


* * 


* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

00 

CM 

(73 

00 

CD 

CM 

CM 

CM 

r“ 

LD 

CM 

00 

cr> 

CM 

00 

00 

00 

CD 

00 

r- 

T- 

00 

LD 

CO 

CM 

uo 

CM 

CM 

00 

CM 

CM 

CM 

CM 

00 

00 

00 

00 

00 

r“ 

o 

cd 

o 

o 

O 

o 

O 

o 

O 

o 

O 

O 

o 

o 

o 

o 

o 

o 

o 

O 

o 

t— 

t— 

r“ 

r- 

r“ 

r- 

o 

o 

o 

o 

o 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

00 

o 

00 

CD 

ID 

CD 

ID 

00 

o 

(73 

C73 

(73 

o 

00 

CD 

00 

03 

00 

CD 

CD 

CD 

CD 

CD 

CD 

LD 

ID 

LD 

'cr 

o 

o 

ID 

o 

ID 

o 

o 

o 

LD 

LD 

LD 

LD 

uo 

o 

O 

O 

o 

m 

m 

o 

r' 

LD 

ID 

LD 

o 

o 

o 

o 

00 

00 

00 

00 

00 

00 

00 

LD 

ID 

LD 

03 

00 

ID 

ID 

CD 

CD 

CD 

ID 

ID 

CO 

00 

CM 

CM 

00 

LO 

ID 

CD 

CD 

CD 

00 

00 

(73 

CM 

- 

ID 

CM 

CM 

CM 

CM 

CM 

00 

00 

00 

00 

00 

00 

CO 

o 

o 

O 

o 

O 

O 

O 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

O 

r— 

r“ 

r“ 

r— 

T“ 

r“ 

T~ 

t— 

T— 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

CM 

CM 

00 

00 

00 

00 

00 

CO 

00 

00 

00 

CO 

CM 

CM 

r“ 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

O 

O 

o 

O 

O 

ID 

o 

LD 

o 

LD 

LD 

o 

o 

o 

o 

o 

o 

o 

O 

O 

o 

(73 

00 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

uo 

LD 

LD 

00 

CD 

CD 

ID 

CD 

00 

00 

LD 

LD 

LD 

00 

00 

CD 

O 

o 

r- 

ID 

o 

CD 

uo 

O 

173 

C73 

03 

O 

LD 

00 

r- 

CT3 

CD 

ID 

CD 

CD 

CD 

CD 

CD 

ID 

LD 

LD 

CD 

LD 

LD 

ID 

LD 

o> 

C73 

r- 

ID 

C7> 

OJ 

CM 

CM 

00 

CD 

O 

ID 

00 

CD 

CM 

o 

CO 

CM 

CM 

CM 

CM 

00 

00 

LD 

ID 

CM 

CM 

00 

00 

CM 

CM 

CM 

CM 

(\J 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

O 

CT3 

O 

C7) 

O 

h' 

O 

O 

O 

00 

<73 

r“ 

O 

r- 

r- 

LO 

CD 

LO 

LD 

o 

O 

O 

O 

o 

CD 

CM 

CM 

CD 

ID 

CD 

CD 

CD 

CD 

CD 

CD 

CO 

CD 

CD 

CD 

LD 

LD 

LD 

ID 

r- 

V— 

r“ 

r” 

r" 

T— 

r“ 

X — 

r“ 

CM 

00 

ID 

CD 

00 

(73 

o 

T— 

CM 

00 

LD 

CD 

CO 

00 

00 

00 

00 

CO 

00 

00 

00 

00 

(73 

CJ3 

C73 

C7> 

03 

<73 

(7) 

03 

C73 

i 

I 


I 


66 


Table  6:  Rating  statistics  for  each  item  Continued 


* 

* 

* 

* 

* 

* 

* 

o 

o 

CD 

OJ 

m 

00 

00 

fVI 

CD 

O 

o 

(M 

ou 

CM 

00 

* 

* 

* 

* 

* 

(J) 

lD 

CD 

LO 

CM 

CD 

CO 

00 

T- 

o 

I I 


C75  r-  O T—  to 

LO  LO  LO  T—  LD 

O r-  o o o 

III  II 


■O 

(U 

+-I 

sz 

O) 

'oi 

5 

m 


c 

(tj 

+-> 

LO 


o 

O 

o 

O 

o 

o 

O 

O 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

LD 

o 

o 

o 

o 

uo 

LO 

LO 

o 

o 

o 

o 

o 

o 

lO 

o 

LD 

LD 

CD 

CD 

CD 

CD 

o 

o 

o 

o 

o 

o 

(J> 

C7> 

00 

CD 

CD 

CD 

CD 

CD 

LO 

o 

o 

o 

o 

o 

o 

CD 

CT5 

o 

00 

00 

00 

CD 

o 

o 

o 

o 

o 

o 

CD 

LO 

LO 

CD 

LO 

CD 

CD 

CD 

o 

o 

o 

r- 

o 

r- 

o 

o 

CD 

00 

00 

00 

t — 

CM 

CM 

CD 

CD 

CD 

00 

00 

o 

CM 

CO 

C7) 

00 

00 

r- 

CD 

CD 

r- 

o 

CM 

CD 

CID 

CM 

CM 

CM 

00 

CM 

00 

00 

CM 

CM 

r- 

O 

o 

00 

CD 

O 

CD 

CD 

CD 

CD 

o 

00 

00 

LO 

CM 

CO 

CM 

00 

(/) 

lO 

LO 

lO 

lO 

CD 

CD 

lO 

CD 

LO 

LO 

CD 

lO 

CD 

cd’ 

CD 

s_ 

o 

> 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

00 

00 

CL) 

QQ 

CD 

cn 

r) 

TJ- 

r“ 

r- 

(T5 

o 

r- 

CM 

00 

LO 

CD 

(/) 

00 

CD 

o 

CM 

00 

rr 

lO 

CJ> 

o 

o 

O 

o 

o 

o 

O 

o 

U) 

o 

o 

T — 

r— 

r“ 

3 

s_ 

Q 

67 


Table  6.  Rating  statistics  for  each  item  Continued 


3 

ifl 

C 

o 

u 


<u 

c 

CL 


O 

ifl 

O) 

c 

'■M 

<0 

O) 

c 

> 

O) 


o 

z 


o> 

to 

00 

00 

00 

CD 

00 

00 

CM 

to 

to 

nr 

nr 

CO 

CD 

CM 

in 

o 

o 

r“ 

o 

00 

00 

00 

r“ 

00 

nr 

o 

CM 

CM 

in 

o 

CM 

nr 

"D 

1 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

d 

•M 

1 

1 

1 

of 

S. 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

O 

o 

a; 

r“ 

r— 

T“ 

r- 

r— 

o 

+-* 

z 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

c 

(XJ 

00 

o 

CM 

in 

to 

CM 

in 

CO 

to 

to 

CD 

(D 

CD 

0) 

E 

00 

d 

to 

d 

to 

to 

d 

in 

d 

d 

in 

d 

of 

w 

s_ 

0) 

^:r 

nr 

nr 

nr 

nr 

nr 

nr 

nr 

nr 

nr 

'tf 

o 

fU 

z 

1. 

o 

o 

o 

o 

in 

o 

o 

in 

o 

o 

in 

o 

o 

o 

o 

in 

o 

o 

(T3 

in 

o 

in 

in 

C'. 

o 

o 

CM 

o 

o 

in 

o 

in 

o 

CM 

in 

o 

(1) 

E 

CT) 

1^ 

1^ 

d 

1^ 

O' 

r'" 

d 

d 

d 

d 

d 

d 

d 

d 

u 

o 

X 

0) 

1 

CO 

m 

in 

CO 

00 

in 

00 

CO 

00 

00 

nr 

nr 

00 

r* 

a> 

00 

CO 

00 

00 

00 

m 

CO 

in 

CO 

CD 

(D 

00 

00 

> 

0} 

t. 

00 

o 

1 

o 

o 

o 

r- 

o 

r- 

T“ 

r- 

CM 

CM 

CM 

00 

CM 

CM 

00 

0 

a 

X 

ni 

E 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

O 

o 

r* 

r" 

r“ 

r" 

r- 

r" 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

c 

LO 

00 

00 

CO 

00 

00 

00 

00 

CM 

CM 

00 

CM 

CM 

CM 

CM 

E 

c 

(D 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

O 

O 

o 

O 

O 

O 

o 

■a 

m 

in 

o 

o 

o 

o 

in 

in 

o 

in 

in 

O 

O 

o 

O 

O 

in 

in 

(U 

(T) 

r'' 

00 

d 

d 

d 

00 

d 

d 

d 

d 

d 

d 

d 

nr 

'T 

E 

■o 

0) 

■M 

x: 

O) 

'oj 

5 

c 

CM 

<D 

a> 

r- 

00 

to 

m 

00 

CM 

CM 

00 

o 

CM 

CM 

0) 

lO 

o 

CM 

to 

CXJ 

to 

m 

00 

CD 

to 

O 

T 

o 

CQ 

E 

O) 

f'' 

d 

to 

d 

d 

to 

d 

nr 

nr 

in 

d 

nr 

m 

, 

r>j 

00 

in 

CO 

f'' 

in 

00 

CD 

nr 

00 

nr 

in 

nr 

in 

m 

C 

00 

to 

to 

CO 

00 

to 

in 

00 

o 

CD 

m 

o 

00 

CD 

o 

(TJ 

0> 

■!-> 

c/) 

■o 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

00 

CM 

CM 

oo 

CM 

CM 

00 

c 

o 

00 

CD 

00 

CO 

nr 

nr 

to 

CD 

CD 

nr 

CD 

nr 

<T3 

(U 

to 

o 

CM 

CO 

nr 

00 

to 

00 

LO 

r' 

to 

E 

00* 

d 

d 

d 

d 

d 

d 

d 

d 

<X) 

d 

in 

(/) 

o 

1. 

0) 

nr 

nr 

nr 

nr 

nr 

nr 

nr 

nr 

n 

(T3 

r— 

r— 

r~ 

r“ 

r“ 

r~“ 

n” 

r- 

z 

DC 

d 

z 

to 

00 

oo 

o 

\ — 

CM 

00 

in 

to 

00 

(D 

o 

r" 

CM 

00 

T- 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

00 

00 

00 

00 

E 

V— 

\ — 

r— 

r~ 

r- 

r- 

T~" 

(U 

-M 

68 


Table  6.  Rating  statistics  for  each  item  Continued 


(TJ 

o 

o 

o 

o 

o 

o 

o 

O 

o 

O 

o 

o 

o 

o 

O 

o 

o 

o 

•0 

o 

lO 

o 

o 

kO 

o 

o 

lO 

lO 

UO 

cn 

o 

o 

o 

o 

lO 

o 

o 

a; 

00 

cd 

CO 

od 

od 

p^ 

P^ 

p^ 

■D 

O) 

> 

'o) 

5 

tz 

V 

fO 

eo 

CO 

r— 

CO 

o 

00 

PO 

CM 

o 

o 

CO 

CM 

00 

<T 

00 

(£> 

CO 

CO 

05 

05 

CO 

05 

oo 

CM 

O) 

CM 

CO 

ro 

E 

rN- 

CO 

cd 

P^ 

cd 

p^ 

cd 

cd 

cd 

p^ 

p^ 

CO 

r- 

CO 

p^ 

oo 

lO 

lO 

05 

00 

CM 

uo 

o 

CO 

CM 

Stan 

> 

OJ 

CM 

lO 

O 

05 

lO 

oo 

o 

o 

r* 

05 

05 

CO 

ao 

•o 

C\j 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

CM 

c 

fO 

a; 

05 

m 

CO 

05 

05 

CO 

P^ 

CJ5 

PN. 

o 

i£) 

o 

iD 

00 

p^ 

P^ 

05 

CM 

o 

CM 

uo 

o 

id 

CO 

p^ 

cd 

r*- 

CO 

cd 

P^ 

p^ 

o 

L. 

0) 

'T 

o 

fd 

* 

r* 

r“ 

r- 

r- 

z 

CE 

d 

z 

lO 

CO 

oo 

05 

o 

CM 

m 

lO 

CO 

P^ 

00 

C75 

o 

m 

CO 

cn 

ro 

cn 

'T 

'T 

IT 

lO 

vO 

£ 

0) 


69 
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Table  6.  Rating  statistics  for  each  item  Continued 
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Table  6.  Rating  statistics  for  each  item  Continued 
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Table  6.  Rating  statistics  for  each  item  Continued 
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Figure  1 . Bivariate  plot  for  panel  and  consultants 
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Figure  1 is  a bivariate  plot  of  the  panel  mean  ratings  against  the  consultant  mean  ratings 
for  all  473  items.  A global  examination  of  the  plot  reveals  a positive  linear  trend,  visually 
depiciting  the  significant  correlation  coefficient.  At  least  two  features  of  the  plot  are  worth 
noting.  First,  the  linear  trend  does  not  seem  oriented  to  the  origin  but  rather  is  positively 
elevated  on  the  consultant  axis.  The  second  obvious  feature  is  a bulge  in  the  upper  left 
corner.  This  resulted  from  certain  items  receiving  a high  rating  by  the  consultants  and  a low 
rating  by  the  panel.  While  many  items  fall  into  this  category,  only  two  outlying  items  fall  into 
the  converse  category.  In  other  words,  only  two  items  are  clearly  in  the  lower  right  corner 
where  items  rated  high  by  the  panel  and  low  by  the  consultants  would  fall.  This  is  a pictorial 
display  of  some  of  the  significant  t-differences  obtained  in  table  6,  which,  for  the  vast  majority, 
had  high  mean  ratings  from  the  consultants  relative  to  the  panel. 

Finally,  linear  regression  analyses  were  run  and  equations  generated  for  the  panel  and 
consultant  mean  ratings  for  the  473  items.  When  attempting  to  predict  or  estimate  the  panel 
mean  rating  from  the  consultant  mean  rating  the  following  equations  were  generated.  For  the 
raw  or  unstandardized  data: 

Estimated  panel  mean  = .60  (consultant  mean)  + 1.354; 

while  when  all  variables  are  normalized  to  have  a mean  of  zero  and  a standard  derivation  of 
one,  the  standardized  equation  is 

Estimated  panel  mean  = .47  (consultant  mean). 

As  an  example,  assume  the  consultant  mean  on  item  X was  5.0  as  a raw,  unstandardized  score. 
Using  the  first  equation  for  the  raw  data  it  is  estimated  that  the  panel  raw,  unstandardized 
mean  for  item  X would  be  4.354. 

Equations  were  also  generated  for  predicting  the  consultant  mean  from  the  panel  mean. 
For  the  raw  or  unstandardized  data: 

Estimated  consultant  mean  = .37  (panel  mean)  + 4.684; 
while  for  standardized  variables  the  equation  is 

Estimated  consultant  mean  = .47  (panel  mean). 

It  is  clear  from  these  analyses  that  the  panel  generally  rated  items  less  favorably  than 
the  consultants,  and  that  a linear  model  can  capture  a good  portion  of  the  discrepancies  in 
ratings  between  the  two  groups. 

Rankings  of  the  individual  items 

Since  we  anticipate  that  many  readers  will  be  interested  in  how  the  judges  ranked  the 
items  in  terms  of  overall  quality  and  necessity,  we  present  item  rankings  in  table  7.  The 
ranking  was  made  on  the  basis  of  the  biweight  mean  rating.  In  table  7 we  present  the  rank 
and  biweighted  mean  for  each  item.  A rank  of  "1"  indicates  the  highest  mean  favorability 
rating.  We  also  show  from  which  of  the  13  major  clusters  of  variables  the  item  is  derived.  Of 
the  50  highest  priority  items,  40  are  drug-taking  behaviors.  Five  items  in  the  "top  50"  con- 
cern psychological  health. 
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Table 

7.  Item  ranks 

based  upon 

biweight 

means 

Rank 

Biweighted 
Item  No.  mean 

Area 

Rank 

Item  No. 

Biweighted 

mean 

Area 

5.0 

161 

10.00 

Drugs 

51.0 

396 

8.28 

PsyHIth 

5.0 

159 

10.00 

Drugs 

52.5 

187 

8.27 

Drugs 

5.0 

157 

10.00 

Drugs 

52.5 

50 

8.27 

Deviance 

5.0 

113 

10.00 

Drugs 

54.0 

182 

8.18 

Drugs 

5.0 

112 

10.00 

Drugs 

55.0 

383 

8.12 

PsyHIth 

5.0 

111 

10.00 

Drugs 

56.0 

284 

8.11 

LifeSat 

5.0 

110 

10.00 

Drugs 

57.0 

370 

8.10 

PsyHIth 

5.0 

109 

10.00 

Drugs 

58.0 

207 

8.09 

SES 

5.0 

108 

10.00 

Drugs 

59.5 

288 

8.03 

LifeSat 

10.0 

270 

9.79 

PsySoc 

59.5 

278 

8.03 

LifeSat 

11.0 

188 

9.78 

Drugs 

61.0 

205 

7.92 

SES 

12.0 

160 

9.66 

Drugs 

63.0 

384 

7.91 

PsyHIth 

13.0 

173 

9.63 

Drugs 

63.0 

293 

7.91 

LifeSat 

15.0 

172 

9.61 

Drugs 

63.0 

139 

7.91 

Drugs 

15.0 

114 

9.61 

Drugs 

65.0 

221 

7.86 

InterRel 

15.0 

9 

9.61 

Acc/Hosp 

66.0 

273 

7.85 

PsySoc 

17.5 

158 

9.57 

Drugs 

67.5 

386 

7.83 

PsyHIth 

17.5 

116 

9.57 

Drugs 

67.5 

134 

7.83 

Drugs 

20.5 

165 

9.55 

Drugs 

69.0 

144 

7.82 

Drugs 

20.5 

164 

9.55 

Drugs 

71.0 

272 

7.77 

PsySoc 

20.5 

163 

9.55 

Drugs 

71.0 

271 

7.77 

PsySoc 

20.5 

162 

9.55 

Drugs 

71.0 

209 

7.77 

SES 

23.0 

175 

9.41 

Drugs 

73.0 

140 

7.76 

Drugs 

24.0 

178 

9.34 

Drugs 

74.0 

42 

7.75 

Deviance 

28.0 

174 

9.31 

Drugs 

75.0 

269 

7.73 

PsySoc 

28.0 

171 

9.31 

Drugs 

76.0 

385 

7.71 

PsyHIth 

28.0 

170 

9.31 

Drugs 

77.0 

388 

7.70 

PsyHIth  ; 

28.0 

169 

9.31 

Drugs 

79.0 

380 

7.66 

PsyHIth 

28.0 

168 

9.31 

Drugs 

79.0 

298 

7.66 

LifeSat 

28.0 

167 

9.31 

Drugs 

79.0 

135 

7.66 

Drugs 

28.0 

166 

9.31 

Drugs 

81.0 

70 

7.63 

PhysHIth 

32.0 

185 

9.26 

Drugs 

82.5 

389 

7.62 

PsyHIth 

33.0 

368 

9.22 

PsyHIth 

82.5 

149 

7.62 

Drugs  | 

34.0 

81 

9.14 

PhysHIth 

84.0 

317 

7.60 

LifeSat  | 

35.0 

177 

9.10 

Drugs 

85.0 

371 

7.58 

PsyHIth  ,! 

36.0 

176 

9.08 

Drugs 

86.0 

210 

7.56 

SES 

37.0 

115 

8.79 

Drugs 

88.0 

390 

7.55 

PsyHIth  1 

38.5 

184 

8.74 

Drugs 

88.0 

208 

7.55 

SES  ; 

38.5 

181 

8.74 

Drugs 

88.0 

192 

7.55 

Drugs 

40.0 

379 

8.64 

PsyHIth 

90.5 

55 

7.54 

MarReact 

41 .0 

179 

8.62 

Drugs 

90.5 

8 

7.54 

Acc/Hosp 

42.0 

49 

8.50 

Deviance 

92.0 

378 

7.51 

PsyHIth 

43.0 

376 

8.46 

PsyHIth 

93.5 

122 

7.46 

Drugs 

44.0 

375 

8.45 

PsyHIth 

93.5 

118 

7.46 

Drugs 

45.0 

186 

8.38 

Drugs 

95.0 

274 

7.45 

PsySoc 

46.0 

189 

8.37 

Drugs 

96.0 

153 

7.44 

Drugs 

48.0 

204 

8.34 

SES 

97.5 

155 

7.43 

Drugs 

48.0 

183 

8.34 

Drugs 

97.5 

154 

7.43 

Drugs 

48.0 

180 

8.34 

Drugs 

99.0 

126 

7.42 

Drugs 

50.0 

374 

8.32 

PsyHIth 

100.0 

206 

7.40 

SES 
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Table  7.  Item  ranks  based  upon  biweight  means  Continued 


Rank 

Biweighted 
Item  No.  mean 

Area 

Rank 

Item  No. 

Biweighted 

mean 

Area 

T5T76 

194 

7.39 

Drugs 

155.0 

67 

6.88 

PhysHIth 

102.0 

318 

7.38 

LifeSat 

155.0 

66 

6.88 

PhysHIth 

103.0 

222 

7.37 

1 nterRel 

157.0 

53 

6.86 

MarReact 

104.0 

71 

7.36 

PhysHIth 

158.0 

123 

6.85 

Drugs 

105.0 

142 

7.33 

Drugs 

159.5 

195 

6.84 

SES 

106.5 

292 

7.32 

LifeSat 

159.5 

12 

6.84 

Acc/Hosp 

106.5 

10 

7.32 

Acc/Hosp 

161.5 

68 

6.83 

PhysHIth 

108.0 

440 

7.31 

LongEff 

161.5 

36 

6.83 

Deviance 

109.5 

365 

7.30 

LifeSat 

163.5 

463 

6.81 

LongEff 

109.5 

193 

7.30 

Drugs 

163.5 

412 

6.81 

ShrtEff 

111.0 

119 

7.29 

Drugs 

165.0 

392 

6.79 

PsyHIth 

112.0 

148 

7.26 

Drugs 

166.0 

87 

6.76 

PhysHIth 

113.0 

217 

7.23 

SES 

167.5 

145 

6.74 

Drugs 

114.5 

366 

7.20 

LifeSat 

167.5 

4 

6.74 

Acc/Hosp 

114.5 

146 

7.20 

Drugs 

169.0 

291 

6.73 

LifeSat 

116.5 

150 

7.18 

Drugs 

170.5 

277 

6.72 

PsySoc 

116.5 

124 

7.18 

Drugs 

170.5 

1 

6.72 

Acc/Hosp 

118.0 

38 

7.17 

Deviance 

172.5 

391 

6.71 

PsyHIth 

119.0 

395 

7.16 

PsyHIth 

172.5 

120 

6.71 

Drugs 

120.0 

435 

7.15 

LongEff 

174.0 

285 

6.69 

LifeSat 

121.0 

137 

7.14 

Drugs 

176.0 

367 

6.68 

LifeSat 

122.0 

51 

7.13 

MarReact 

176.0 

264 

6.68 

1 nterRel 

123.0 

190 

7.12 

Drugs 

176.0 

54 

6.68 

MarReact 

124.5 

364 

7.10 

LifeSat 

178.5 

393 

6.66 

PsyHIth 

124.5 

56 

7.10 

MarReact 

178.5 

138 

6.66 

Drugs 

126.0 

37 

7.09 

Deviance 

180.0 

289 

6.65 

LifeSat 

127.5 

382 

7.08 

PsyHIth 

181.0 

307 

6.64 

LifeSat 

127.5 

82 

7.08 

PhysHIth 

182.5 

121 

6.63 

Drugs 

130.0 

191 

7.07 

Drugs 

182.5 

88 

6.63 

PhysHIth 

130.0 

100 

7.07 

PhysHIth 

184.5 

266 

6.62 

1 nterRel 

130.0 

86 

7.07 

PhysHIth 

184.5 

125 

6.62 

Drugs 

132.0 

241 

7.06 

InterRel 

186.0 

72 

6.61 

PhysHIth 

133.0 

265 

7.04 

InterRel 

187.0 

214 

6.58 

SES 

134.0 

213 

7.03 

SES 

188.5 

369 

6.57 

PsyHIth 

135.0 

117 

7.02 

Drugs 

188.5 

127 

6.57 

Drugs 

137.0 

373 

7.00 

PsyHIth 

190.0 

211 

6.56 

SES 

137.0 

310 

7.00 

LifeSat 

191.0 

85 

6.55 

PhysHIth 

137.0 

3 

7.00 

Acc/Hosp 

192.0 

436 

6.53 

LongEff 

139.5 

387 

6.97 

PsyHIth 

193.5 

220 

6.52 

SES 

139.5 

58 

6.97 

MarReact 

193.5 

216 

6.52 

SES 

142.0 

439 

6.95 

LongEff 

196.5 

218 

6.51 

SES 

142.0 

107 

6.95 

PhysHIth 

196.5 

203 

6.51 

SES 

142.0 

57 

6.95 

MarReact 

196.5 

89 

6.51 

PhysHIth 

144.0 

33 

6.94 

Deviance 

196.5 

52 

6.51 

MarReact 

146.0 

394 

6.93 

PsyHIth 

200.5 

473 

6.50 

LongEff 

146.0 

143 

6.93 

Drugs 

200.5 

450 

6.50 

LongEff 

146.0 

63 

6.93 

PhysHIth 

200.5 

397 

6.50 

ShortEff 

148.0 

455 

6.92 

LongEff 

200.5 

48 

6.50 

Deviance 

150.5 

311 

6.90 

LifeSat 

203.5 

377 

6.49 

PsyHIth 

150.5 

196 

6.90 

SES 

203.5 

276 

6.49 

PsySoc 

150.5 

147 

6.90 

Drugs 

205.5 

242 

6.47 

1 nterRel 

150.5 

141 

6.90 

Drugs 

205.5 

79 

6.47 

PhysHIth 

153.0 

381 

6.89 

PsyHIth 

207.5 

320 

6.45 

LifeSat 

155.0 

69 

6.88 

PhysHIth 

207.5 

2 

6.45 

Acc/Hosp 
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Table  7.  Item  ranks  based  upon  biweight  means  Continued 


Rank 

Biweighted 
Item  No.  mean 

Area 

Rank 

Item  No. 

Biweighted 

mean 

Area 

210.0 

215 

6.44 

SES 

263.0 

403 

6.11 

ShrtEff 

210.0 

156 

6.44 

Drugs 

263.0 

304 

6.11 

LifeSat 

210.0 

64 

6.44 

PhysHIth 

265.0 

59 

6.08 

MarReact 

212.0 

239 

6.43 

InterRel 

266.5 

299 

6.07 

LifeSat 

214.5 

423 

6.42 

ShrtEff 

266.5 

73 

6.07 

PhysHIth 

214.5 

268 

6.42 

InterRel 

268.5 

456 

6.04 

LongEff 

214.5 

197 

6.42 

SES 

268.5 

454 

6.04 

LongEff 

214.5 

44 

6.42 

Deviance 

271.0 

247 

6.03 

InterRel 

217.0 

421 

6.41 

ShrtEff 

271 .0 

94 

6.03 

PhysHIth 

218.5 

43 

6.40 

Deviance 

271 .0 

90 

6.03 

PhysHIth 

218.5 

35 

6.40 

Deviance 

273.5 

306 

6.02 

LifeSat 

221.0 

295 

6.39 

LifeSat 

273.5 

131 

6.02 

Drugs 

221.0 

244 

6.39 

1 nterRel 

275.5 

300 

6.01 

LifeSat 

221.0 

106 

6.39 

PhysHIth 

275.5 

230 

6.01 

InterRel 

223.5 

237 

6.38 

InterRel 

277.0 

39 

6.00 

Deviance 

223.5 

136 

6.38 

Drugs 

279.0 

460 

5.99 

LongEff 

227.0 

445 

6.36 

LongEff 

279.0 

228 

5.99 

InterRel 

227.0 

313 

6.36 

LifeSat 

279.0 

61 

5.99 

PhysHIth 

227.0 

286 

6.36 

LifeSat 

281.0 

399 

5.98 

ShrtEff 

227.0 

279 

6.36 

LifeSat 

282.5 

438 

5.97 

LongEff 

227.0 

105 

6.36 

PhysHIth 

282.5 

404 

5.97 

ShrtEff 

231.5 

281 

6.34 

LifeSat 

284.5 

437 

5.96 

LongEff 

231.5 

152 

6.34 

Drugs 

284.5 

409 

5.96 

ShrtEff 

231.5 

151 

6.34 

Drugs 

288.0 

408 

5.95 

ShrtEff 

231.5 

65 

6.34 

PhysHIth 

288.0 

238 

5.95 

InterRel 

234.0 

308 

6.33 

LifeSat 

288.0 

93 

5.95 

PhysHIth 

235.0 

372 

6.30 

PsyHIth 

288.0 

92 

5.95 

PhysHIth 

237.0 

468 

6.29 

LongEff 

288.0 

91 

5.95 

PhysHIth 

237.0 

466 

6.29 

LongEff 

291.0 

443 

5.94 

LongEff 

237.0 

78 

6.29 

PhysHIth 

292.0 

283 

5.92 

LifeSat 

239.0 

448 

6.28 

LongEff 

293.0 

80 

5.91 

PhysHIth 

240.5 

319 

6.26 

LifeSat 

294.0 

447 

5.90 

LongEff 

240.5 

41 

6.26 

Deviance 

295.5 

451 

5.89 

LongEff 

242.5 

470 

6.24 

LongEff 

295.5 

104 

5.89 

PhysHIth 

242.5 

223 

6.24 

1 nterRel 

297.5 

415 

5.88 

ShrtEff 

244.5 

303 

6.23 

LifeSat 

297.5 

199 

5.88 

SES 

244.5 

267 

6.23 

1 nterRel 

299.5 

198 

5.87 

SES 

246.0 

458 

6.22 

LongEff 

299.5 

13 

5.87 

Acc/Hosp 

247.0 

323 

6.21 

LifeSat 

302.0 

425 

5.86 

ShrtEff 

248.5 

449 

6.20 

LongEff 

302.0 

401 

5.86 

ShrtEff 

248.5 

442 

6.20 

LongEff 

302.0 

74 

5.86 

PhysHIth 

250.0 

11 

6.19 

Acc/Hosp 

304.0 

417 

5.85 

ShrtEff 

252.0 

414 

6.18 

ShrtEff 

305.0 

32 

5.84 

Deviance 

252.0 

305 

6.18 

LifeSat 

306.0 

472 

5.82 

LongEff 

252.0 

212 

6.18 

SES 

307.5 

471 

5.81 

LongEff 

255.5 

464 

6.16 

LongEff 

307.5 

309 

5.81 

LifeSat 

255.5 

302 

6.16 

LifeSat 

310.0 

419 

5.80 

ShrtEff 

255.5 

103 

6.16 

PhysHIth 

310.0 

263 

5.80 

InterRel 

255.5 

83 

6.16 

PhysHIth 

310.0 

60 

5.80 

MarReact 

258.0 

434 

6.15 

ShrtEff 

312.0 

246 

5.78 

InterRel 

259.0 

461 

6.14 

LongEff 

314.5 

410 

5.77 

ShrtEff 

260.5 

457 

6.13 

LongEff 

314.5 

229 

5.77 

InterRel 

260.5 

262 

6.13 

1 nterRel 

314.5 

219 

5.77 

SES 

263.0 

459 

6.11 

LongEff 

314.5 

200 

5.77 

SES 

94 


Table  7.  Item  ranks  based  upon  biweight  means  Continued 


Rank 

Biweighted 
Item  No.  mean 

Area 

Rank 

Item  No. 

Biweighted 

mean 

Area 

31^5 

430 

5.76 

ShrtEff 

372.5 

429 

5.34 

ShrtEff 

318.5 

84 

5.76 

PhysHIth 

372.5 

275 

5.34 

PsySoc 

318.5 

40 

5.76 

Deviance 

374.0 

45 

5.33 

Deviance 

318.5 

7 

5.76 

Acc/Hosp 

375.0 

24 

5.32 

Leisure 

323.5 

467 

5.75 

LongEff 

377.0 

431 

5.31 

ShrtEff 

323.5 

465 

5.75 

LongEff 

377.0 

297 

5.31 

LifeSat 

323.5 

422 

5.75 

ShrtEff 

377.0 

96 

5.31 

PhysHIth 

323.5 

413 

5.75 

ShrtEff 

379.0 

405 

5.30 

ShrtEff 

323.5 

411 

5.75 

ShrtEff 

380.0 

314 

5.29 

LifeSat 

323.5 

245 

5.75 

1 nterRel 

381.0 

34 

5.28 

Deviance 

327.0 

76 

5.72 

PhysHIth 

382.5 

294 

5.27 

LifeSat 

328.5 

433 

5.71 

ShrtEff 

382.5 

62 

5.27 

PhysHIth 

328.5 

407 

5.71 

ShrtEff 

384.0 

406 

5.26 

ShrtEff 

330.5 

462 

5.70 

LongEff 

385.5 

427 

5.24 

ShrtEff 

330.5 

240 

5.70 

1 nterRel 

385.5 

416 

5.24 

, ShrtEff 

332.5 

424 

5.68 

ShrtEff 

387.0 

28 

5.23 

Leisure 

332.5 

243 

5.68 

1 nterRel 

388.5 

233 

5.20 

1 nterRel 

334.0 

75 

5.67 

PhysHIth 

388.5 

226 

5.20 

InterRel 

335.0 

235 

5.63 

InterRel 

391.0 

428 

5.16 

ShrtEff 

336.5 

444 

5.62 

LongEff 

391.0 

102 

5.16 

PhysHIth 

336.5 

232 

5.62 

InterRel 

391.0 

97 

5.16 

PhysHIth 

338.0 

130 

5.61 

Drugs 

393.0 

452 

5.15 

LongEff 

340.0 

400 

5.58 

ShrtEff 

394.0 

321 

5.14 

LifeSat 

340.0 

225 

5.58 

InterRel 

395.0 

22 

5.13 

Leisure 

340.0 

95 

5.58 

PhysHIth 

396.5 

296 

5.11 

LifeSat 

342.0 

290 

5.57 

LifeSat 

396.5 

236 

5.11 

1 nterRel 

343.0 

453 

5.56 

LongEff 

398.0 

98 

5.10 

PhysHIth 

344.5 

432 

5.55 

ShrtEff 

399.0 

287 

5.09 

LifeSat 

344.5 

312 

5.55 

LifeSat 

400.0 

133 

5.07 

Drugs 

346.5 

255 

5.53 

InterRel 

401.0 

418 

5.03 

ShrtEff 

346.5 

254 

5.53 

1 nterRel 

402.0 

282 

5.02 

LifeSat 

348.5 

322 

5.52 

LifeSat 

403.0 

99 

4.98 

PhysHIth 

348.5 

77 

5.52 

PhysHIth 

404.0 

14 

4.97 

Leisure 

350.0 

469 

5.51 

LongEff 

405.0 

26 

4.95 

Leisure 

351.0 

47 

5.50 

Deviance 

406.0 

202 

4.94 

SES 

352.0 

441 

5.49 

LongEff 

407.5 

251 

4.90 

InterRel 

353.5 

234 

5.48 

InterRel 

407.5 

129 

4.90 

Drugs 

353.5 

231 

5.48 

InterRel 

409.0 

128 

4.88 

Drugs 

355.5 

446 

5.47 

LongEff 

411.0 

353 

4.86 

LifeSat 

355.5 

23 

5.47 

Leisure 

411.0 

326 

4.86 

LifeSat 

358.0 

316 

5.45 

LifeSat 

411.0 

27 

4.86 

Leisure 

358.0 

227 

5.45 

InterRel 

413.0 

18 

4.85 

Leisure 

358.0 

31 

5.45 

Leisure 

414.0 

349 

4.83 

LifeSat 

360.0 

101 

5.44 

PhysHIth 

415.0 

16 

4.82 

Leisure 

361.0 

30 

5.42 

Leisure 

416.0 

359 

4.81 

LifeSat 

362.0 

315 

5.41 

LifeSat 

417.0 

339 

4.79 

LifeSat 

363.0 

398 

5.40 

ShrtEff 

418.0 

347 

4.77 

LifeSat 

365.0 

280 

5.39 

LifeSat 

419.0 

420 

4.69 

ShrtEff 

365.0 

257 

5.39 

1 nterRel 

420.0 

325 

4.65 

LifeSat 

365.0 

256 

5.39 

1 nterRel 

421.0 

334 

4.64 

LifeSat 

367.0 

402 

5.38 

ShrtEff 

422.0 

301 

4.63 

LifeSat 

368.5 

224 

5.37 

InterRel 

423.0 

21 

4.60 

Leisure 

368.5 

201 

5.37 

SES 

424.0 

340 

4.59 

LifeSat 

370.5 

248 

5.35 

InterRel 

426.0 

25 

4.58 

Leisure 

370.5 

29 

5.35 

Leisure 

426.0 

17 

4.58 

Leisure 
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Table  7.  Item  ranks  based  upon  biweight  means  Continued 


Rank 

Item  No. 

Biweighted 

mean 

Area 

426.0 

15 

4.58 

Leisure 

428.0 

46 

4.52 

Deviance 

429.0 

350 

4.49 

LifeSat 

430.0 

19 

4.48 

Leisure 

431.5 

346 

4.47 

LifeSat 

431.5 

20 

4.47 

Leisure 

433.0 

336 

4.46 

LifeSat 

434.0 

426 

4.45 

ShrtEff 

435.0 

345 

4.43 

LifeSat 

436.0 

341 

4.39 

LifeSat 

437.0 

362 

4.38 

LifeSat 

438.0 

357 

4.35 

LifeSat 

439.5 

250 

4.31 

1 nterRel 

439.5 

249 

4.31 

1 nterRel 

441.0 

352 

4.27 

LifeSat 

442.5 

363 

4.25 

LifeSat 

442.5 

5 

4.25 

Acc/Hosp 

444.0 

327 

4.19 

LifeSat 

445.0 

337 

4.17 

LifeSat 

446.5 

330 

4.16 

LifeSat 

446.5 

253 

4.16 

1 nterRel 

448.0 

329 

4.13 

LifeSat 

449.0 

132 

4.12 

Drugs 

450.5 

358 

4.08 

LifeSat 

450.5 

333 

4.08 

LifeSat 

452.0 

355 

4.04 

LifeSat 

453.0 

328 

4.02 

LifeSat 

454.0 

252 

3.98 

InterRel 

455.0 

348 

3.95 

LifeSat 

456.0 

344 

3.83 

LifeSat 

457.0 

338 

3.81 

LifeSat 

458.0 

342 

3.80 

LifeSat 

459.5 

259 

3.79 

InterRel 

459.5 

258 

3.79 

InterRel 

461.0 

361 

3.76 

LifeSat 

462.0 

324 

3.75 

LifeSat 

463.5 

343 

3.73 

LifeSat 

463.5 

335 

3.73 

LifeSat 

465.0 

360 

3.70 

LifeSat 

466.0 

6 

3.63 

Acc/Hosp 

467.0 

332 

3.62 

LifeSat 

468.5 

354 

3.57 

LifeSat 

468.5 

351 

3.57 

LifeSat 

470.0 

331 

3.44 

LifeSat 

471.5 

261 

3.39 

1 nterRel 

471.5 

260 

3.39 

1 nterRel 

473.0 

356 

3.36 

LifeSat 
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Comparisons  of  central  tendency  statistics 


We  have  emphasized  the  utility  and  advantages  of  employing  the  biweighted  mean  as  an 
informative  index  of  central  tendency.  However,  some  empirical  justification  of  our  bias  for  it 
is  in  order,  since  others  may  prefer  the  more  known  or  standard  statistics  of  central  tendency, 
such  as  the  arithmetic  mean,  median,  or  mode.  (As  noted  earlier,  we  have  also  reported  the 
standard  mean  and  median,  as  well  as  the  biweighted  mean  in  table  6.)  In  order  to  determine 
whether  the  biweighted  mean  makes  substantial  difference  in  our  interpretation  of  the  ratings, 
we  calculated  the  product-moment  correlations  among  the  mean,  biweighted  mean,  and  median 
for  all  raters  on  all  items.  In  addition,  we  computed  the  Spearman  rank  correlations  coef- 
ficients among  the  mean,  biweighted  mean,  and  median,  for  all  raters  and  all  items,  since  such 
a coefficient  explicitly  addresses  the  issue  of  whether  rankings  based  on  the  different  central 
tendency  measures  will  be  about  the  same. 

Looking  first  at  the  product-moment  correlations,  we  found  that  the  biweighted  mean 
correlated  .97  with  the  standard  mean  and  .96  with  the  median.  In  addition,  the  standard 
mean  and  median  correlated  .94.  These  coefficients  indicate  that  there  is  a great  deal  of 
empirical  similarity  between  the  biweighted  mean  and  the  standard  mean  and  median-.  In  fact, 
over  94  percent  of  the  variance  between  the  biweighted  mean  and  the  standard  mean  is  shared 
commonly  by  the  two. 

More  pivotal  to  our  use  of  the  various  central  tendency  measures  is  whether  each  pro- 
vides about  the  same  information  for  ranking  the  items.  We  next  examined  the  nonparametric 
Spearman  rank  correlation  coefficients  among  the  three  measures.  We  found  that  the  biweighted 
mean  correlated  .99  with  the  standard  mean  and  .96  with  the  median.  The  median  and  standard 
mean  were  correlated  .94,  a value  identical  to  that  of  the  product-moment  correlation.  These 
coefficients  suggest  that  ranks  based  on  any  of  the  central  tendency  measures  will  lead  to  the 
selection  of  about  the  same  items. 

These  results,  combined  with  the  theoretical  advantages  of  using  the  biweighted  mean 
offered  earlier,  tend  to  support  our  preference  and  urging  for  the  use  of  the  biweighted  mean 
as  the  prominent  statistic  of  central  tendency,  although  either  of  the  other  summaries  will  also 
be  quite  adequate. 

Comparing  favorability  ratings  for  pairs  of  items 

We  realize  that  many  readers  will  wish  to  use  the  ratings  given  in  table  6 for  the  in- 
dividual items  in  conjunction  with  the  rankings  given  in  table  7 to  select  "highest  priority" 
items.  There  are  several  issues  which  must  be  considered  when  using  the  ratings  for  that 
purpose.  The  following  comments  pertain  to  major  issues  identified  by  the  UCLA  group. 

1.  The  items  in  the  overall  questionnaire  are  sometimes  quite  redundant  with  one  an- 
other. Thus  the  investigator  who  chooses  a subset  of  the  items  should  do  so  only  after  a 
careful  examination  of  the  item  content  in  the  total  set  of  selected  items  in  order  to  remove  re- 
dundancy. In  general,  if  only  a certain  number  of  items  can  be  used  in  a battery  because  of 
time  constraints,  we  believe  that  it  is  more  important  to  sample  many  areas  than  to  blindly  use 
only  the  k highest  ranked  items.  It  is  probably  more  important  to  use  an  item  from  a domain 
which  is  not  represented  among  the  k highest  ranked  items  than  it  is  to  include  several  re- 
dundant measures  of  the  same  construct.  While  the  UCLA  group  did  try  to  eliminate  some  re- 
dundancy in  the  item  set  before  the  battery  was  sent  out  for  ranking,  we  did  leave  moderate 
amounts  of  redundancy  to  reflect  both  the  item  sets  as  they  were  submitted  to  us,  and  to  allow 
the  raters  to  differentiate  between  several  alternate  ways  of  measuring  the  same  construct. 

2.  Frequently  there  are  no  statistical  differences  between  the  item  rankings,  so  that, 
for  instance,  an  item  ranked  as  number  105  may  have  a mean  rating  which  is  not  statistically 
different  from  the  item  ranked  number  147.  The  rankings  are  subject  to  a reasonable  amount 
of  statistical  variability,  and  it  is  not  appropriate  to  consider  the  ordering  to  be  "etched  in 
stone."  Rather,  the  ranks  and  the  mean  ratings  should  be  treated  as  estimates  which  have  a 
certain  amount  of  variability. 
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Some  readers  may  question  why  we  did  not  simply  compute  t-tests  (or  some  non- 
parametric  alternative)  to  determine  whether  the  mean  rating  for  item  x is  significantly  dif- 
ferent from  the  mean  rating  for  item  y.  The  data  analyst  will  recognize  that  such  an  enter- 
prise would  necessitate  473  x 472/2  comparisons.  It  is  our  belief  that  even  if  the  111,628 
t-tests  had  been  computed,  very  few  individuals  would  try  to  comprehend  the  total  pattern  of 
results  and  very  few  would  be  willing  to  examine  the  4 inch  thick  holder  necessary  to  file  the 
results.  Consequently,  for  those  who  wish  to  form  a rough  index  of  whether  item  mean  ratings 
are  significantly  different  from  one  another,  we  offer  the  following  procedure.  It  should  be 
emphasized  that  the  following  method  is  rough,  approximate,  and  contingent  upon  our  choice  of 
relevant  assumptions.  On  the  other  hand,  this  rough  index  will  provide  a more  accurate 
yardstick  under  which  to  judge  the  amount  of  dissimilarity  in  mean  ratings  than  simple  visual 
inspection.  While  the  method  is  an  easy  approximate  one,  it  is  reasonably  well  grounded  in 
accepted  statistical  and  data  analysis  theories. 

We  should  first  consider  the  formula  for  a matched-pair  t-test.  One  way  to  write  the 
formula  is: 

M(1)  - M(2) 

t = g-  [1] 

((var(1)  + var(2)  - 2sd(1 )sd(2)r)/N ) ' 

Where  M(1)  and  M(2)  are  the  two  means  being  considered,  var(1)  and  var(2)  are  the  variances 
for  the  two  items,  sd(1)  and  sd(2)  are  the  standard  deviations  (square  roots  of  variances),  N 
is  equal  to  the  number  of  observations,  and  r is  the  product-moment  correlation  coefficient 
between  the  ratings  for  the  two  items.  From  formula  1,  it  should  immediately  be  clear  that 
when  the  means  and  standard  deviations  are  held  constant,  increasing  the  value  for  the  cor- 
relation coefficient  will  increase  the  value  of  the  t-statistic.  That  is,  a given  mean  difference 
of  a certain  size  is  most  statistically  significant  when  the  variables  are  highly  positively  cor- 
related and  least  significant  when  the  variables  are  highly  negatively  correlated.  Following  the 
logic  of  Mosteller  and  Tukey  (1977)  we  could  replace  the  sample  estimates  of  means,  variances, 
and  the  correlation  in  formula  1 with  robust  estimates.  For  the  present  purposes  we  will  use 
biweight  means  as  a robust  estimate  of  the  means,  develop  a specialized  estimate  of  r below, 
and  use  the  regular  variances  as  variance  estimates. 

Given  that  it  is  as  impossible  to  report  the  111,628  product-moment  correlations  among  the 
different  items  as  it  is  to  report  that  many  t-tests,  we  might  ask  how  we  might  approximate 
the  t-test  value  using  a simple  formula.  The  easiest  way  that  we  know  would  be  to  make  the 
assumption  that  the  item  ratings  are  not  correlated.  Given  such  an  assumption,  we  could 
simplify  formula  1 to  the  following 

M(1)  - M(2) 

t = E-  [2] 

((var(1)  + var(2))/14)-^ 

Formula  2 is  generally  a little  more  conservative  than  formula  1 if  the  items  are  indeed  pos- 
itively correlated.  Since  almost  all  item  pairs  should  be  correlated  positively,  it  would  not  be 
inappropriate  to  use  formula  2 with  the  appropriate  biweighted  means  and  standard  deviations 
from  Table  6 when  the  investigator  wanted  to  calculate  whether  two  selected  items  were  sign- 
ificantly different  from  one  another.  If  formula  2 is  used,  we  would  suggest  using  a t-value 
of  about  3.0  as  an  indication  that  there  is  a difference. 

To  illustrate  the  use  of  formula  2,  let  us  compare  item  number  1 and  item  number  5.  The 
biweighted  mean  rating  for  item  1 is  6.72  with  a standard  deviation  of  2.92.  The  biweight 
mean  rating  for  item  5 is  4.25  with  a standard  deviation  of  2.27.  If  we  square  the  standard 
deviations  to  obtain  estimates  of  the  variances  and  then  apply  formula  2 to  these  numbers  with 
a total  N of  14,  we  find  that  the  value  of  t is  2.50.  Using  our  rough  criterion  of  3.0  or 
above,  we  would  judge  that  the  raters  were  not  more  favorable  on  the  average  to  item  1 than 
they  were  to  item  5,  although  there  is  some  tendency  toward  such  a ranking. 
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Since  we  expect  that  the  item  ratings  are  generally  positive  correlated,  at  least  to  a small 
degree,  we  should  like  to  take  that  correlation  into  account  in  calculating  the  t-statistics  in  a 
manner  similar  to  that  given  in  formula  1.  One  solution  to  the  problem  of  attempting  to  deal 
computationally  with  all  item  correlations  is  to  use  the  same  value  in  all  t-tests  that  we  might 
wish  to  perform  to  determine  whether  a pair  of  items  is  rated  significantly  differently.  If  we 
agree  that  a common  value  can  be  used,  formula  1 can  be  amended  to  formula  3: 

M(1)  - M(2) 

t = . [3] 

((var(1)  + var(2)  - .7sd(1)sd(2))/14)-'' 

Formula  3 is  derived  from  formula  1 by  setting  the  value  of  r to  be  .35  and  fixing  N as  14. 
Formula  3 can  be  very  easily  used  with  a hand  calculator,  or  implemented  in  a simple  program. 
The  analyst  who  wishes  to  compare  two  items  can  calculate  the  statistic  for  that  comparison 
easily.  For  a given  comparison,  the  investigator  would  substitute  the  appropriate  values  for 
the  two  biweighted  means  and  the  two  standard  deviations  from  table  6.  A t-like  statistic  is 
then  generated.  Again,  we  would  use  the  value  of  3.0  as  a rough  cutoff  for  the  conclusion 
that  we  have  a significant  difference  or  not. 

We  should  note  that  the  values  of  t generated  by  formula  3 will  generally  be  about  35 
percent  larger  than  those  generated  by  formula  2 since  the  correction  term  is  incorporated  in 
the  denominator.  We  illustrate  the  calculation  for  the  same  contrast  of  items  1 and  5 as  was 
done  previously  with  formula  2.  The  biweighted  mean  for  item  1 is  6.72  with  a standard 
deviation  of  2.92  while  the  biweighted  mean  for  item  5 is  4.25  with  a standard  deviation  of 
2.27.  Using  formula  3,  we  find  that  t is  3.07.  We  conclude  that  the  judges  were  more  favor- 
able to  item  1 than  they  were  to  item  5 but  that  this  difference  is  only  marginally  statistically 
reliable.  For  purposes  of  illustration,  by  the  way,  we  note  that  item  1 has  a rank  of  170.5 
while  item  5 has  rank  442.5,  so  we  can  conclude  that  in  general,  items  which  are  widely 
separated  in  the  rankings  will  be  only  marginally  different  from  one  another  when  we  take  into 
account  the  variability  in  the  item  ratings. 

Three  questions  must  be  asked  if  we  are  to  apply  formula  3 with  some  degree  of  con- 
fidence. First,  where  does  the  t cutoff  value  of  3 come  from?  The  value  of  3 was  selected 
because  the  two-tailed  critical  value  necessary  for  a .99  confidence  interval  with  13  degrees  of 
freedom  is  3.01.  We  rounded  since  we  are  making  rough  decisions  on  statistical  formulas  so  we 
can  also  use  rough  cutoff  points.  A two-tailed  interval  is  appropriate  since  there  is  no  strong 
theory  about  directionality  which  is  appropriate.  Second,  where  does  the  average  correlation 
value  of  .35  come  from?  In  order  to  make  a rough  guess  as  to  the  correlation  among  the  item 
judgments,  we  examined  the  correlations  among  average  item  ratings  for  the  judges  given  in 
the  upper  triangular  portion  of  table  9.  Using  the  numbers  in  this  table  we  calculated  the 
average  correlation  (first  normalizing  the  coefficients  using  Fisher's  transformation , and  then 
back-transforming  the  average  normalized  value).  The  average  obtained  from  table  9 was  .38. 
Since  smaller  numbers  give  more  conservative  results,  we  rounded  .38  slightly  down  to  .35  to 
make  the  results  just  slightly  more  conservative  while  also  making  hand  calculations  easier. 
By  the  way,  we  would  not  recommend  making  the  test  less  conservative  by  increasing  the 
constant.  Third,  why  have  we  chosen  to  test  the  significance  of  biweight  means?  In  practice, 
given  the  approximate  nature  of  the  results,  one  could  substitute  means  into  formula  3 and 
obtain  just  about  the  same  result.  Although  biweighted  means  do  not  share  the  same  statistical 
theory  as  unweighted  means,  it  would  seem  most  desirable  to  confine  decisions  to  the  central 
tendency  measures  which  we  believe  will  be  robust  over  new  selections  of  raters.  Robustness 
is  a very  critical  issue  here  since  it  is  not  entirely  clear  what  we  should  consider  the  universe 
of  raters  to  be,  and  in  fact  the  universe  of  potential  raters  will  ultimately  be  defined  as  that 
group  of  people  who  use  this  report. 
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Table  8.  Ratings  within  each  content  area  by  judge 
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Differences  between  areas  in  mean  ratings 


It  seems  useful  to  examine  the  way  in  which  the  different  judges  rated  the  items  from  the 
13  areas  on  the  average.  Table  8 presents  the  mean  rating  for  each  judge  on  each  of  the 

items  in  the  13  areas.  In  addition  to  the  mean  rating  we  also  give  a standard  deviation  for  the 

ratings.  The  judges  are  subdivided  into  consultants  and  panel  members.  We  also  give  an 
average  of  all  consultants  and  all  panel  members.  As  might  be  surmised  from  the  results  of 
tables  1 and  6,  there  are  sometimes  a few  missing  values.  Since  there  are,  however,  very  few 
missing  values  in  any  of  the  means,  we  have  decided  to  treat  the  means  as  not  invalidated  by 
trivial  amounts  of  missing  ratings.  It  should  be  noted,  however,  that  means  and  standard 
deviations  are  based  only  on  ratings  which  are  present. 

Examining  table  8,  we  can  first  see  that  in  general  the  judges  rated  the  Drug  Use  Be- 
haviors items  most  highly.  Consultant  1 gave  the  items  the  lowest  mean  rating  of  5.78  while 
consultant  4 gave  them  the  highest  mean  rating  of  9.23.  The  four  panel  members  rated  the 

necessity  of  including  the  Drug  Use  Behaviors  items,  on  the  average,  just  about  as  highly  as 

the  consultants.  The  items  which  were,  on  the  average,  considered  least  necessary  were  those 
for  Leisure  Time.  Consultant  4 gave  these  items  the  lowest  mean  rating  of  2.17  while  con- 
sultant 8 gave  them  the  highest  mean  rating  of  8.28.  Simply  "eyeballing"  table  8 we  might 
conclude  that  the  judges  are  modestly  consistent  in  their  average  ratings  of  favorability . 

Since  the  judges  have  rated  13  different  domains  of  items,  we  might  wish  to  determine 
how  the  average  favorability  judgements  for  domains  correlated  with  one  another.  We  used  the 
mean  ratings  for  a domain  given  by  a judge  as  a data  point.  We  then  correlated  the  13  domain 
mean  ratings  for  the  14  judges  to  determine  a domain  by  domain  correlation  matrix.  Such  a 
matrix  of  correlation  coefficients  gives  us  information  about  how  highly  correlated  the  average 
ratings  for  different  domains  are.  The  product-moment  correlations  among  the  domains  are 
presented  in  table  9 as  the  upper  triangular  part  of  the  table.  The  lower  part  of  this  matrix 
is  the  matrix  of  Spearman  rank-order  correlation  coefficients  among  the  different  domains.  In 
the  Spearman  procedure,  for  each  of  the  domains  the  judges  are  ranked  in  terms  of  how  high 
their  mean  rating  for  the  domain  was.  These  derived  ranking  scales  are  then  correlated  using 
usual  product-moment  formulae. 

We  might  examine  several  of  the  relationships  portrayed  in  table  9 in  detail.  Our  dis- 
cussion is  based  upon  the  rank-order  correlation  coefficients  (p),  although  it  should  be  noted 
that  the  value  of  the  product-moment  coefficients  are  about  the  same  size  as  the  rank  coef- 
ficients. Rank  coefficients  were  selected  since  with  only  14  observations  on  13  variables  the 
product-moment  correlation  matrix  is  singular  within  the  computer  tolerances  in  the  statistical 
packages  used.  From  the  bottom  triangular  portion  of  table  9,  it  may  be  seen  that  judges  who 
tended  to  rate  Drug  Use  Behavior  items  favorably,  on  the  average,  will  tend  to  rate  SES  and 
Economics  items  highly  (p  = .87).  Interestingly,  there  was  no  correlation  between  average 
favorability  judgments  about  Drug  Use  Behaviors  and  either  items  of  Short-term  Drug  Effects 
(p  = .17)  or  Long-term  Drug  Effects  (p  = .00). 

The  major  trends  in  the  correlations  portrayed  in  table  9 may  be  summarized  by  a prin- 
cipal components  analysis.  The  principal  components  analysis  will  determine  several  major 
dimensions  along  which  judges  differ  in  their  average  favorability  ratings.  The  rank-order 
correlation  coefficients  from  table  9 were  input  to  a principal  components  computer  program  and 
different  numbers  of  components  were  retained  for  rotation  using  the  normalized  varimax 
algorithm  which  yields  orthogonal  (noncorrelated)  dimensions.  In  table  10  we  present  two, 
three,  and  four  rotated  principal  components  from  the  rank-order  correlations  of  table  10.  In 
general  we  prefer  the  three  principal  components  solution.  The  alternate  solutions  are  pre- 
sented for  those  who  might  wish  to  interpret  more  or  less  dimensions. 

In  the  three  components  solution,  the  first  dimension  has  loadings  exceeding  .5  for  Short- 
term Drug  Effects,  Long-term  Drug  Effects,  Psychological  Health,  Life  Satisfaction,  and  Psy- 
chosocial Aspects  of  Drug  Use.  The  second  rotated  dimension  has  loadings  in  excess  of  .5  for 
Accidents  & Hospitalization,  Leisure  Time,  Deviance,  Marijuana  Reactions,  Physical  Health,  and 
Psychological  Health.  The  third  rotated  dimension  has  loadings  in  excess  of  .5  for  Drug  Use 
Behaviors,  SES  and  Economics,  and  Interpersonal  Relations. 
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Table  9.  Spearman  rank-order  and  Pearson  product-moment  correlations  among  judge  area  favorability  means 
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Table  10.  Two,  three,  and  four  orthogonally  rotated  principal  components  for 
Spearman  rank-order  correlations  of  judge  mean  preferences 


Domain 

1 

II 

I' 

II' 

IN' 

1" 

II" 

III" 

IV" 

1 . 

Accidents  and 
hospitalization 

-.14 

.77 

-.10 

.87 

-.01 

-.02 

.00 

.95 

.03 

2. 

Leisure  time 

-.02 

.91 

-.10 

.82 

.40 

-.17 

.39 

.74 

.32 

3. 

Deviance 

.43 

.56 

.37 

.50 

.35 

.02 

.33 

.16 

.86 

4. 

Marijuana  Reactions 

.42 

.66 

.42 

.71 

.18 

.52 

.18 

.80 

.08 

5. 

Physical  Health 

.12 

.80 

.13 

.84 

.16 

-.07 

.15 

.66 

.58 

6. 

Drug  Use  Behaviors 

.28 

.54 

.02 

.13 

.92 

.11 

.92 

.21 

-.11 

7. 

SES  and  Economics 

.41 

.60 

.16 

.22 

.91 

.09 

.90 

.14 

.26 

8. 

Interpersonal  Relations 

.67 

.47 

.46 

.15 

.81 

.31 

.80 

.00 

.45 

9. 

Psychosocial  Aspects  of 
Drug  Use 

.62 

.18 

.56 

.10 

.31 

.81 

.32 

.34 

-.30 

10. 

Life  Satisfaction 

.83 

.36 

.79 

.31 

.33 

.54 

.31 

.07 

.73 

11 . 

Psychological  Health 

.51 

.31 

.63 

.52 

.33 

.41 

-.21 

.33 

.65 

12. 

Short-term  Drug  Effects 

.88 

-.05 

.86 

-.06 

.18 

.87 

.17 

-.05 

.18 

13. 

Long-term  Drug  Effects 

.90 

-.15 

.95 

-.05 

-.01 

.84 

-.03 

-.15 

.41 
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We  can  speculate  about  what  the  principal  components  analysis  presented  in  table  10  tells 
us  about  the  individuals  who  completed  the  rating  tasks  and  the  dimensions  along  which  they 
arrayed  their  ratings.  The  first  dimension  contains  domains  with  items  which  might  be  con- 
sidered to  measure  what  we  could  call  perceived  consequences  of  drug-taking.  Judges  high  on 
this  dimension  felt  that  it  was  very  desirable  to  include  items  about  the  self-perceived  short- 
term and  long-term  consequences  of  drug  use.  They  also  were  favorably  disposed  to  including 
items  about  Psychological  Health  and  Life  Satisfaction.  The  second  dimension  uncovered  in  the 
principal  components  analysis  seems  to  be  an  endorsement  of  the  idea  of  including  items  about 
"objective"  consequences  of  drug-taking.  Judges  scoring  highly  on  this  dimension  would 
prefer  to  include  items  on  such  relatively  objective  activities  as  Accidents  and  Hospitalization, 
the  use  of  Leisure  Time,  and  Physical  Health.  Presumably  judges  high  on  this  dimension 
would  wish  to  compare  the  rates  of  the  different  types  of  behavior  for  users  and  nonusers  of 
marijuana  and  other  drugs  to  determine  whether  there  was  an  observable  change  in  behavior 
attributible  to  drug-taking.  We  also  speculate  that  such  judges  might  wish  to  conduct  long- 
itudinal, proactive  studies  as  opposed  to  retroactive,  concurrent  ones.  The  third  dimension  of 
the  ratings  seems  to  represent  favorableness  toward  including  indicators  of  such  "background" 
characteristics  as  Drug  Use  Behaviors,  SES  and  Economics,  and  Interpersonal  Relations  (such 
as  marital  status,  family  composition,  and  the  like). 

That  the  judges  differ  in  the  degree  to  which  they  would  wish  to  include  "background" 
items  is  not  particularly  surprising.  In  questionnaire  studies  there  is  a striking  difference 
between  investigations  in  the  amount  of  administration  time  that  researchers  are  willing  to 
devote  to  an  assessment  of  these  independent  variables.  We  find  it  quite  interesting  and  sug- 
gestive that  the  two  remaining  dimensions  seem  to  reflect  favorableness  toward  objective  and 
subjective  measures  of  drug  use  consequences.  The  judges  clearly  differ  in  the  degree  to 
which  they  would  rate  objective  behaviors  or  introspective  reports  as  necessary  in  a study  of 
drug-taking  consequences. 

It  is  also  necessary  to  determine  the  extent  to  which  the  average  rankings  of  favorable- 
ness toward  the  different  domains  differ  from  one  another.  When  we  make  such  a test,  it  is 
desirable  to  choose  a test  statistic  which  eliminates  the  effect  of  the  judges  general  "halo,"  or 
tendency  to  give  favorable  ratings  to  all  items.  It  is  also  desirable  to  choose  a method  which 
makes  minimal  distribution  assumptions  about  the  ratings  since  means  form  the  "data"  for  the 
analyses.  Since  we  held  such  considerations  important,  we  choose  to  conduct  such  a test 
using  Friedman's  procedure  for  testing  the  equality  of  repeated  measure  rankings  (see  Daniel 
1978).  The  Friedman  procedure  is  an  analysis  of  variance  on  average  rankings  to  determine 
whether  the  average  rankings  for  the  different  domains  were,  in  total,  statistically  the  same. 
Note  that  in  this  procedure  the  rankings  are  made  within  each  judge.  Thus,  looking  at  the 
numbers  in  table  8,  we  can  see  that  for  consultant  1 the  domain  of  Long-term  Drug  Effects 
items  is  rated  the  highest,  on  the  average,  and  thus  gets  a ranking  of  13  for  that  judge.  The 
domain  of  Deviance  is  rated  the  second  highest  and  thus  gets'  a ranking  of  12.  For  panel 
member  2,  the  domain  of  Psychosocial  Aspects  of  Drug  Use  has  the  highest  rating  and  thus 
gets  a ranking  of  13.  The  domain  of  Physical  Health  has  the  lowest  mean  rating  and  thus  gets 
a rank  of  1 . 

Applying  the  Friedman  test  to  the  ranks  derived  for  each  judge  from  the  mean  ratings  in 
table  8,  we  find  that  we  can  reject  the  null  hypothesis  of  no  difference  between  the  domains 
with  great  confidence  (chi-square  = 43.52,  d.f.  = 12,  p < .001).  The  average  rankings  of 
favorability  toward  the  domains  are  different  from  one  another  when  we  consider  all  13  domains 
at  once. 

Following  the  overall  test  of  the  equality  of  the  domain  rankings,  we  might  ask  whether 
the  mean  rankings  for  the  different  domains  were  the  same.  The  multiple  comparison  procedure 
suggested  by  Daniel  (1978,  p.  231)  following  a significant  Friedman  test  was  used  to  compare 
the  average  rankings  for  the  domains  given  in  table  8.  In  table  11  it  can  be  seen  that  on  the 
average  the  domain  of  Drug  Use  Behaviors  was  the  highest  ranked  with  a mean  ranking  of 
10.0.  Following  in  order  were  the  domains  of  Psychosocial  Aspects  of  Drug  Use  (M  = 9.8), 
Psychological  Health  (M  = 8.7),  Marijuana  Reactions  (M  = 8.3),  Accidents  and  Hospitalization 
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Table  11.  Tests  of  equality  of  rank  means  for  different  areas 
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^Note  that  in  this  table  the  areas  have  been  reordered  from  highest  favorability  to  lowest  favorability  for  ease  in  comparison. 

j 

* Difference  greater  than  zero  using  .05,  two-tailed  usual  confidence  interval. 

**  Difference  greater  than  zero  using  .10,  two-tailed  Bonferroni  simultaneous  confidence  interval. 


(M  = 7.8),  SES  and  Economics  (M  = 7.4),  Deviance  (M  = 7.1),  Long-term  Drug  Effects  (M  = 
6.9),  Physical  Health  (M  = 6.2),  Short-term  Drug  Effects  (M  = 5.9),  Interpersonal  Relations 
(M  = 4.8),  Life  Satisfaction  (M  = 4.4),  and  Leisure  Time  (M  = 3.6). 

In  table  11  we  present  the  table  of  all  possible  post-hoc  multiple  comparisons  between 
pairs  of  rank  means.  The  statistics  presented  should  be  compared  to  a table  of  z values  and 
thus  accordingly  for  a single  hypothesized  difference,  a critical  ratio  of  1.96  would  indicate 
statistical  significance  using  a conventional  two-tailed,  .95  confidence  interval.  If  we  wish  to 
adjust  for  the  post-hoc  nature  of  conducting  all  comparisons  (i.e.  13  x 12/2  = 78  tests),  a 
Bonferroni  approach  to  simultaneous  confidence  intervals  could  be  used  (see  Daniel,  1978,  p. 
231).  Using  that  approach,  a two-tailed  .95  confidence  interval  for  differences  between  mean 
ratings  would  require  a critical  ratio  of  3.41  for  statistical  significance.  On  the  other  hand, 
since  Bonferroni  procedures  are  generally  too  conservative,  it  is  quite  typical  to  use  .90, 
two-tailed  simultaneous  confidence  intervals.  Such  an  interval  for  the  current  problem  is 
±3.22. 

The  numbers  presented  in  the  main  body  of  table  11  are  the  critical  ratios  for  the  test 
that  the  two  domains  in  question  were  given  the  same  average  rank  by  the  judges.  Values 
exceeding  3.22  can  generally  be  taken  to  be  significant.  Such  values  are  denoted  by  a double 
asterisk  (**)  in  table  11.  Values  which  are  only  significant  if  a single  hypothesized  apriori 
comparison  is  made  are  marked  with  a single  asterisk  (*).  Generally  we  would  prefer  the  use 
of  the  simultaneous  confidence  intervals,  and  caution  the  reader  against  interpreting  differen- 
ces which  are  not  marked  by  (**). 

Examining  table  11  it  can  be  seen  that  the  judges  were  more  favorable  to  the  Drug  Use 
Behavior  items,  on  the  average,  than  they  were  to  the  items  for  the  domains  of  Interpersonal 
Relations,  Life  Satisfaction,  and  Leisure  Time.  The  judges  were  also  more  favorable  to  the 
Psychosocial  Aspects  of  Drug  Use  items  than  they  were  to  items  about  Interpersonal  Relations, 
Life  Satisfaction,  and  Leisure  Time.  The  only  other  significant  difference  using  a Bonferroni, 
simultaneous  confidence  interval,  is  that  comparison  between  the  domains  of  Psychological 
Health  and  Leisure  Time  Activities.  We  should  point  out,  however,  that  there  is  evidence  in 
table  11  that  we  cannot  reject,  at  this  time,  the  hypothesis  that  knowledgable  judges  are  about 
equally  favorable,  on  the  average,  to  items  from  many  of  the  pairs  of  domains.  For  instance, 
items  about  Accidents  and  Hospitalization  are  not  ranked  significantly  lower  than  items  about 
Drug  Use  Behaviors.  Most  comparisons  are  not  significant  even  if  we  use  the  liberal  value  of 
1.96  as  the  criterion  for  statistical  "significance." 

Qualitative  comments  from  the  raters 

In  addition  to  providing  the  quantitative  judgements  for  each  item,  most  of  the  raters 
took  the  liberty  of  giving  qualitative  comments  either  on  the  questionnaire  or  in  an  accompany- 
ing letter.  In  fact,  only  four  raters  did  not  volunteer  at  least  some  experience,  suggestion, 
or  reservation  about  rating  the  items.  Some  of  the  issues  that  were  raised  were  broad  and 
directed  to  the  questionnaire  as  a whole,  while  others  addressed  specific  portions  or  items. 

A general  problem  indicated  by  many  raters  was  the  difficulty  running  into  similar  or 
identical  items  throughout  the  questionnaire.  When  compiling  the  questionnaire  an  effort  was 
made  to  combine  similar  content  areas,  resulting  in  the  13  domains.  However,  items  were  not 
deleted  because  of  redundancy  in  order  to  maintain  the  integrity  of  each  subcommittee's  con- 
tribution. Of  those  raters  who  mentioned  the  problem  of  redundancy,  each  arrived  at  an  in- 
dependent decision  to  rate  each  item  on  its  own  ignoring  the  fact  that  there  was  a similar  or 
even  identical  items  elsewhere  in  the  questionnaire.  A second  issue  involved  the  fact  that  re- 
quiring a single  rating  for  each  item  confounded  whether  the  rating  was  for  content  or  format. 
For  example,  in  some  cases  the  content  was  judged  as  essential  but  the  format  was  judged  as 
poor.  As  a general  rule,  those  who  were  plagued  by  this  concern  tended  to  rate  mostly  on 
content  rather  than  form.  Many  raters  noted  that  item  response  categories  were  not  always 
consistent,  even  on  items  with  parallel  content.  It  was  also  noted  by  at  least  one  rater  that 
age  level  had  not  been  specifically  defined  and  particular  items  seemed  to  be  directed  at  one 
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Table  11.  Qualitative  comments  from  the  raters 


Item(s) 

I to  13 

5 and  6 
8 to  10  and 

II  to  13 
14  and  15 

31 

58 

83 

III 
116 
129 

133 

161 

162  to  164 


162 

175  to  187 

176  to  178 
182  to  184 

189 

195  and  196 

203 

205 

218 

236  and  237 
241 

254  to  257 
273 

312  to  323 
397  to  434 


404,  405,  410 
and  429 
422,  424,  427, 
428,  431,  and 
437,  438,  442 
463  & 468 


Comment 


Add  a question  to  Accidents  and  Hospitalization:  "Number  of  times 

visited  a physician?" 

Suggestion  to  combine  into  one  item. 

Parallel  items  that  are  misleading.  The  implication  of  causality  could 
elicit  defensive  denial. 

Unspecified  whether  alone,  together  or  in  a group.  Time  frame  is 
inconsistent  between  questions. 

Preference  for  "week  day"  instead  undefined  "day." 

Need  a definition  for  "hallucination." 

Need  a specific  time  frame. 

Need  a nonuse  category. 

Need  to  define  whether  assessing  a single  use  or  multiple  use. 

Need  to  specify  "other  relative"  more  exactly  (e.g.,  siblings, 
uncle,  etc.). 

Need  to  define  "people"  more  specifically  (e.g.,  co-workers, 
strangers,  etc.).  u 

Should  include  several  categories  for  more  than  10  years. 

Need  multiple  categories  between  nonuse  and  10  times.  Suggest 

using  "last  year"  instead  of  "ever  used."  Need  to  add  PCP. 
Suggest  collapsing  beer,  wine  and  liquor  into  "alcohol." 

Cigarettes  does  not  equal  "other  types  of  tobacco." 

Need  to  add  PCP. 

Suggestion  to  combine  beer,  wine  and  liquor  into  "alcohol." 

Suggestion  to  combine  quaaludes,  downs,  and  tranquilizers  into  one 
category. 

Need  to  specify  "smoke  cigarettes." 

Add  a category  for  "some  college." 

Asks  two  questions.  Good  content,  bad  format. 

Poor  phrasing. 

Objection  to  the  "0"  alternative. 

Confusing . 

Need  to  ask  how  many  children. 

Suggestion  to  add  spouse,  boyfriend,  or  girlfriend. 

"Approximately"  is  a vague  term. 

Need  to  add  a question  about  "Life  as  a whole." 

Immediate  effect  is  not  equivalent  to  short-term  effect.  Objection  to 
the  use  of  the  "other  drug"  category.  Objection  to  including 
cigarettes  and  caffeine  as  drugs. 

Suggestion  to  combine  into  one  question  assessing 
"Avoidance  of  bad  feelings." 

Suggestion  to  combine  into  one  question  assessing 
432  "Relations  with  others." 

Suggestion  to  combine  into  one  question  assessing 
"Avoidance  of  bad  feelings." 
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age  group,  while  other  items  seemed  directed  at  a different  age  group.  Since  the  sources  of 
the  items  or  scales  were  purposely  not  included,  some  raters  felt  they  may  be  tampering  with 
an  established  scale  by  rating  items  differently  in  particular  areas.  Finally,  several  raters 
suggested  that  specific  items  or  areas  should  be  included  that  had  not  been  incorporated  in 
the  questionnaire.  For  example,  one  rater  felt  that  a series  of  questions  should  be  included 
that  assessed  the  fact  of  and  reasons  for  discontinuation  or  reduction  of  marijuana  use. 

Moving  from  the  general  comments  to  the  more  specific  issues,  most  raters  criticized  one 
or  more  of  the  items.  In  order  to  present  these  clearly  the  item  number(s)  beside  it  will  be 
listed  sequentially  with  a paraphrasing  of  the  comment  or  criticism.  These  are  presented  in 
Table  11. 

It  seems  that  many  of  the  individual  comments  about  specific  items  indicate  ways  that  an 
investigator  with  a certain  theoretical  viewpoint,  or  special  population,  would  wish  to  "tune" 
the  items  for  greater  sensitivity  and  validity  in  the  context  of  the  entire  study.  Since  the 
raters  did  not  universally  suggest  that  some  items  be  totally  reworked,  we  would  suggest  that 
the  individual  user  try  to  determine  whether  the  exact  wordings  given  here  are  appropriate  for 
the  sample  used.  If  they  are  not,  we  would  suggest  minor  rewordings  which  minimize  the 
changes. 

The  specific  comments  or  criticisms  seem  circumscribed  and  appear  to  present  little  dif- 
ficulty to  implement.  On  the  other  hand,  the  more  general  or  broad  reservations  may  need 
close  examination  and  evaluation  in  order  to  be  incorporated  into  a final  product.  Clearly, 
these  suggestions  should  prove  very  useful  in  polishing  the  final  version  of  the  questionnaire. 

How  to  select  the  item  set  for  an  individual  study 

In  selecting  items  from  the  list  to  use  in  individual  studies,  we  feel  that  the  inclusion 
criterion  should  be  a multidimensional  one.  A reasonable  set  of  criteria  would  include  the 
following  facets. 

1.  First  and  foremost,  the  individual  investigator  must  examine  this  set  of  items  with  a 
clear  conception  of  the  relevant  theoretical  framework  to  be  tested  firmly  in  mind.  The  item 
set  itself  is  atheoretical  and  many  of  the  individual  items  may  be  adapted  to  measure  latent 
constructs  in  many  different  theoretical  systems.  The  selection  of  individual  indicators  from 
this  list  should,  therefore,  be  done  in  combination  with  a careful  statement  of  the  latent  vari- 
ables the  investigator  needs  to  study  in  a careful  test  of  major  extant  theories  of  the  phen- 
omenon under  investigation.  Theoretical  importance  is  a major  reason  for  selecting  an  individ- 
ual item,  and  indeed  might  be  the  most  important  reason.  It  is  the  position  of  the  UCLA 
Center  that  the  judgment  of  importance  for  assessing  a particular  theory  with  a special  type  of 
item  must  be  primarily  left  to  the  discretion  of  the  individual  researcher. 

2.  Second,  as  was  apparent  in  the  factor  analysis  of  the  perceived  importance  ratings  for 
the  different  domains,  the  judges  tended  to  rate  the  importance  of  including  items  along  separ- 
able dimensions  of  "objective,  proactive  indicators"  and  "subjective,  retrospective  indicators." 
The  factor  analysis  serves  to  underscore  a second  judgment  which  must  be  made  by  the  in- 
dividual investigator.  This  second  judgment  concerns  the  type  of  study  conducted.  It  makes 
little  sense  to  include  indicators  which  are  objective  in  the  sense  that  we  would  be  interested 
in  determining  their  change  over  time  in  a proactive  study  if  the  only  form  of  data  collection 
which  is  available  is  concurrent  assessment.  Similarly,  an  investigator  who  is  seeking  to 
conduct  a longitudinal  investigation  may  wish  to  focus  attention  upon  "objective"  indicators 
rather  than  items  which  ask  the  participant  to  subjectively  attribute  certain  events  or  psycho- 
logical characteristics  to  the  use  of  one  or  more  forms  of  drugs.  Again  it  is  the  opinion  of  the 
UCLA  Center  that  fundamental  design  decisions  in  favor  of  proactive  or  retrospective  studies 
should  be  made  by  the  individual  researcher  in  consultation  with  recognized  experts  in  research 
design . 

3.  A third  judgment,  which  is  again  at  the  discretion  of  the  researcher,  is  the  major 
focus  of  the  study.  We  believe  that  individual  item  selections  will  generally  vary  as  a function 
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of  whether  the  major  intention  of  the  study  is  to  study  etiology,  consequences,  or  evaluate 
some  program.  Item  selection  will  also  vary  as  a function  of  the  type  of  sample  selected. 
Some  of  the  items  will  be  deemed  inappropriate  for  certain  groups  of  individuals.  For  instance, 
it  would  make  little  sense  to  ask  many  questions  about  the  spouses  of  an  unselected  group  of 
13-year-olds . 

4.  Given  that  the  items  are  first  preselected  by  the  individual  researcher  in  a theoretical 
way  after  applying  criteria  1-3  above,  it  would  be  desirable  to  eliminate  undue  amounts  of 
redundancy  using  the  item  rating  information  presented  here.  As  noted  earlier,  many  in- 
dividuals may  wish  to  utilize  the  rankings  given  in  table  7.  We  should  reiterate  that  the 
researcher  must  recognize  that  the  importance  ratings  for  items  separated  by  a few  places  in 
the  rankings  will  not  be  statistically  different  from  one  another.  Of  the  many  different  stat- 
istics presented  in  table  6,  a few  are  the  most  important  for  the  purposes  of  selecting  items. 

First,  the  individual  investigator  might  wish  to  examine  the  measures  of  central  tendency. 
These  measures  include  the  biweighted  mean,  the  median,  and  the  mean.  If  these  ratings  are 
very  high,  the  item  might  be  included,  and  conversely  if  the  ratings  are  very  low,  the  item 
might  be  excluded.  It  is  quite  important,  however,  to  examine  the  standard  deviation  of  the 
ratings  in  combination  with  the  central  tendency  measures.  A large  standard  deviation  in- 
dicates that  the  judges  did  not  generally  concur  in  their  ratings  while  a small  standard  devi- 
ation indicates  a large  degree  of  agreement.  The  same  information  about  judge  consensus  is 
also  given  in  a rough,  but  easily  understood  form,  in  the  table  6 presentation  of  the  number 
of  raters  who  gave  the  item  a rating  of  "poor"  (1-3),  "acceptable"  (4-7),  or  "excellent"  (8-10). 
As  a general  rule,  if  many  raters  gave  the  item  an  "excellent"  rating  we  would  tend  to  include 
it.  Items  which  get  acceptable  or  excellent  rating  from  almost  all  raters  with  only  one  or  two 
"poors"  are  again  generally  acceptable.  The  user  should  exercise  caution  in  using  items  over 
which  the  judges  were  split  in  their  opinions.  Such  items  would  have  large  standard  deviat- 
ions, and  ratings  will  be  spread  widely  among  the  three  categories  reported. 

Of  the  different  central  tendency  measures  reported,  we  express  some  preference  for  the 
biweighted  mean  since  that  statistic  is  designed  to  weight  extreme  ratings  less  in  calculating 
the  central  tendency.  This  statistic  is  less  sensitive  to  the  effects  of  one  or  two  extreme 
raters  than  the  more  usual  (unweighted)  mean  or  average.  The  biweighted  mean  also  makes 
more  use  of  the  total  information  in  the  ratings  than  the  median,  so  we  base  our  preference 
upon  this  criterion  as  well.  It  should  be  noted,  however,  that  the  items  can  also  be  ranked 
on  the  unweighted  means  or  the  medians  with  about  the  same  ordering  obtained,  so  long  as  the 
researcher  is  aware  that  there  is  random  calibration  error  in  the  rankings. 
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From  a Federal  vantage  point,  it  is  valuable  to  foster  cross-study  comparability.  It  is 
our  intent  in  this  chapter  to  recommend  a brief  set  of  questionnaire  items,  sufficiently  general 
in  nature,  so  as  to  be  utilizable  across  a variety  of  projects  concerned  with  delineating  some  of 
the  potential  consequences  of  marijuana  use.  Many  strongly  believe  that  marijuana  use  has 
seriously  detrimental  psychological  and  physical  effects  although  the  precise  nature  and  extent 
of  these  consequences  among  different  types  of  users  have  yet  to  be  fully  elucidated.  The 
items  we  have  selected  represent  our  best  hunches  as  to  which  life  domains  are,  and  will  be 
affected.  Additionally,  we  strongly  encourage  researchers  to  add  other  items  reflecting  their 
best  hunches  as  well.  Clearly  the  overall  aim  of  our  short  list  of  questionnaire  items,  provided 
in  chapter  4,  is  merely  to  give  us  some  telling  clues  as  to  what  domains  should  be  further 
explored  and  studied  in  the  future. 

It  should  also  be  noted  that  enhanced  comparability  of  drug  data  across  various  cross- 
sectional  studies  is  both  economical  and  heuristic.  While  the  sine  qua  non  for  studies  on  the 
consequences  of  drug  use  would  be  long-term  prospective  longitudinal  studies,  such  endeavors 
are  very  expensive  to  mount  and  require  many  years  before  fruition.  An  alternate  goal  is  to 
facilitate  the  comparison  of  findings  across  a wide  range  of  short-term  cross-sectional  studies. 
The  compilation  of  the  items  in  this  volume  is  a first  step  towards  that  goal. 

In  reviewing  those  life  domains  in  which  one  might  expect  to  witness  possible  drug  use  or 
misuse  consequences  our  panel  of  experts  selected  twelve  areas,  generally  viewed  as  dependent 
variables,  and  one  independent  variable  "Drug  Use  Behaviors." 

Dependent  variables 

Psychosocial  aspects  of  drug  use 
Adverse  marijuana  reactions 
Psychological  health 
SES-Economics 
Deviance 

Accidents -Hospitalization 
Physical  Health 
Leisure  time 
Interpersonal  relations 
Life  satisfaction 
Short  term  marijuana  effects 
Long  term  marijuana  effects 

Perhaps  the  most  essential  domain  necessitating  high  comparability  across  studies  is  that 
of  "Drug  Use  Behaviors."  While  a number  of  dimensions  of  drug-use  behavior  have  been 
distinguished,  at  least  five  dimensions  are  worthy  of  special  note. 

(1)  Prevalence,  or  occurrence  of  drug  use  at  least  once  in  a 
stated  time  period. 

(2)  Incidence,  time  (or  age)  of  first  occurrence  of  use. 

(3)  Recency  or  currency,  the  time  of  the  last  occurrence  of  use. 

(4)  Frequency,  the  number  of  times  use  has  occurred  in  a stated 
time  period. 

(5)  Quantity,  the  amount  of  drug  used  in  a stated  period. 


Independent  variables 
Drug  use  behaviors 
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Concerning  stated  periods  in  which  use  has  occurred  our  panel  agreed  that  three  periods 
would  suffice  for  most  purposes:  (1)  use  in  the  last  30  days,  (2)  use  in  the  last  12  months, 
and  (3)  use  over  the  subject's  life  time. 

Obviously  it  would  be  highly  desirable  to  establish  firm  criteria  for  distinguishing  drug 
users  on  some  light  to  heavy  use  continuum.  For  instance,  marijuana  use  on  a daily  basis  or 
high  frequency,  over  a long  period,  in  large  quantity,  could  constitute  the  most  extreme 
parameter  on  a continuum  of  light  to  heavy  use.  One  parsimonius  procedure  is  to  ask  a single 
question  which  combines  the  dimensions  of  prevalence  and  frequency. 

Prevalence  and  frequency 

We  have  selected  three  questions  which  combine  the  prevalence  and  frequency  dimensions. 
Question  108  asks  about  lifetime  prevalence  and  frequency;  111  limits  the  inquiry  to  the  last  12 
months,  while  112  focuses  on  the  last  30  days. 

Prevalence 


Utilizing  the  notion  of  daily  use  lasting  at  least  one  month,  we  recommend  two  items  to 
tap  daily  prevalence.  Question  161  focuses  on  daily  prevalence  lasting  more  than  one  month, 
while  question  157  deals  with  daily  prevalence  of  at  least  one  month. 

Incidence 


It  is  generally  of  interest  to  know  when  (i.e.,  at  what  age)  use  first  began,  (question 
109)  and  then  at  what  age  use  escalated  to  daily  use  which  lasted  at  least  one  month  (question 
158). 

Recency  or  currency 

Three  aspects  of  recency  of  use  are  minimally  essential  to  allow  the  researcher  to  dis- 
aggregate his  sample  of  current  and  former  users.  Most  importantly  one  needs  to  assess  whe- 
ther the  subject  is  responding  to  the  questions  while  currently  under  the  influence  of  mariju- 
ana; moreover  the  general  inquiry  of  last  time  use  occurred  can  be  addressed  with  question 
110.  In  addition  recency  of  daily  prevalence  (question  159)  and  the  last  time  the  subject  used 
daily  lasting  one  month  (question  160)  afford  further  information  upon  which  to  disaggregate 
one's  sample. 

Quantity 

For  most  general  purposes  it  may  be  sufficient  to  attempt  to  roughly  measure  the  amount 
of  drug  used  within  the  last  30  day  period  (question  113). 

In  addition  to  these  five  basic  dTmensions  some  researchers  have  argued  that  questions 
about  the  users'  subjective  effects  could  be  viewed  as  indirect  measures  of  the  quantity  and/or 
potency  of  the  drug.  Question  115  asks  how  high  one  gets  while  116  focuses  on  how  long  one 
stays  high. 

It  is  well  known  that  set  and  setting  can  influence  the  user's  subjective  effects.  More- 
over, the  potency  of  illicitly  purchased  drugs  is  widely  variant.  While  it  would  be  method- 
ologically neat  to  establish  a firm  definition  as  to  what  constitutes  low,  moderate,  or  heavy 
use,  the  reality  of  the  drug  scene  does  not  allow  such  facile  definitions.  Rather  than  firmly 
assign  some  criterion  (e.g.  heavy  marijuana  use  is  defined  as  five  or  more  joints  per  day)  we 
recommend  that  each  investigator  examine  the  correlations  or  trends  between  degree  of  effects 
and  degree  of  drug  usage.  Each  generation  of  users  establishes  differential  normative  drug 
behavior  patterns.  Different  subgroups  within  one  era  would  subjectively  define  heavy  use 
differentially.  In  some  adolescent  groups,  daily  use  of  marijuana  would  qualify  as  heavy  use. 
For  the  parents  of  those  adolescents,  once  a month  usage  might  be  seen  as  heavy  use.  In 


113 


addition  to  the  normative  patterns,  a host  of  other  factors  muddy  the  definitional  waters.  For 
example,  the  extent  of  the  consequences  of  marijuana  use  may  be  better  instanced  by  the 
average  depth  of  inhalation  per  joint  rather  than  the  number  of  joints,  or  by  the  potency  of 
the  marijuana,  or  by  the  interactive  effects  of  marijuana  taken  contemporaneously  with  other 
drugs. 

Depending  on  the  nature  of  the  investigator's  sample,  other  relevant  questions  should  be 
asked  concerning  use  of  drugs  other  than  marijuana.  The  most  essential  of  these  concern 
alcohol,  cigarettes,  and  PCP.  If  time  permits,  inquiry  should  be  made  about  LSD,  other  psy- 
chedelics, cocaine,  heroin,  amphetamines,  quaaludes,  barbiturates,  tranquilizers,  and  other 
narcotics.  Below  we  have  listed  all  our  suggested  drug-use  items.  Those  items  with  an 

asterisk  denote  our  selections  of  the  most  essential  and  hence  most  highly  recommended  Items. 
The  unasterisked  items  are  highly  desirable  but  each  investigator  must  decide  upon  their 
inclusion  based  on  his/her  particular  study  sample  and  project  focus. 

DRUG  USE  BEHAVIORS 

108*  About  how  many  times  altogether  (if  any)  have  you  ever  used  marijuana 
or  hashish?  Circle  one  answer. 

1 . Never  used 

2.  1-9  times 

3.  10-39  times 

4.  40-59  times 

5.  60-99  times 

6.  100-999  times 

7.  1,000  times  or  more 

109*  How  old  were  you  when  you  first  tried  marijuana  or  hashish? 

(indicate  age)  years 

110*  When  was  the  most  recent  time  you  used  marijuana  or  hashish?  Circle  one  answer. 

1.  Today 

2.  Yesterday 

3.  3 to  7 days  ago 

4.  2 to  4 weeks  ago 

5.  One  to  12  months  ago 

6.  More  than  12  months  ago 

If  you  circled  "more  than  12  months  ago",  go  to  question  162. 

Ill*  How  often  did  you  use  marijuana  or  hashish  during  the  PAST  12 
MONTHS?  Circle  one  answer. 

1 . Once  or  twice  during  the  year 

2.  Three  to  11  times  during  the  year 

3.  Once  a month 

4.  Two  or  three  times  a month 

5.  Once  a week 

6.  Two  or  three  times  a week 

7.  Four  to  six  times  a week 

8.  Every  day 


If  you  circled  never  used,  go  to 
question  162  in  next  section. 


If  you  circled  any  other  item,  go  to 
question  109. 
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Circle 


• How  often  (if  at  all)  have  you  used  marijuana  or  hashish  during  the  last  30  days? 
one  answer. 


1 . 

None 

2. 

Once  a month 

3. 

Two  or  three  times  a month 

4. 

Once  a week 

5. 

Two  or  three  days  a week 

6. 

Four  to  six  days  a week 

7. 

Every  day 

During  the  LAST  30  DAYS  about 

how  many  marijuana 

cigarettes  (joints,  reefers),  or  the 

equivalent,  did  you  smoke  a day. 

on  the  average?  (If 

you  shared  them  with  other  people. 

count  only  the  amount  YOU  smoked.)  Circle  one  answer. 

1 . 

None 

2. 

Less  than  one  a day 

3. 

One  a day 

4. 

Two  to  three  a day 

5. 

Four  to  six  a day 

6. 

Seven  or  more  a day 

Has  there  ever  been  a period  in  your  life  when  you  used  marijuana  or  hashish  on  a daily. 

or 

almost  daily,  basis  for  at  least 

a month?  Circle  one 

answer. 

1 . 

Yes 

2. 

No 

159*  Do  you  still  use  marijuana  or  hashish  on  a daily  or  near-daily  basis?  Circle  one  answer. 

1 . Yes 

2.  No 

161*  Altogether,  adding  up  the  different  months  when  you  use  DAILY,  for  about  how  much  of 
your  lifetime  would  you  estimate  that  you  have  used  marijuana  and/or  hashish  daily  or 
almost  daily?  Circle  one  answer. 

1.  Less  than  3 months 

2.  Three  to  9 months 

3.  About  1 year 

4.  About  years 

5.  About  2 years 

6.  About  3 to  5 years 

7.  Six  to  9 years 

8.  Ten  or  more  years 

158*  How  old  were  you  when  you  first  smoked  marijuana  or  hashish  that  frequently? 

years  old 

age 

160*  If  not,  how  old  were  you  when  you  last  used  marijuana  or  hashish  that  frequently? 

years  old 

age 
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How  often  have  you  ever  used  alcohol?  Circle  one  answer. 


I63b 


Never 

1-9 

10-39 

40-59 

60-99 

100-999 

1,000  or 

used 

times 

times 

times 

times 

times 

more  times 

1 

2 

3 

4 

5 

6 

7 

How  often  have  you 

ever  used 

each  of 

these  substances? 

Circle  one 

answer  for 

each . 

Never 

1-9 

10-39 

40-59 

60-99 

100-999 

1,000  or 

used 

times 

times 

times 

times 

times 

more  times 

163* 

BEER  or  WINE  1 

2 

3 

4 

5 

6 

7 

164* 

WINE  1 

2 

3 

4 

5 

6 

7 

165* 

LIQUOR 
gin,  vodka, 
whiskey,  etc.  1 

2 

3 

4 

5 

6 

7 

162* 

CIGARETTES 
or  some  other 
kind  of  tobacco  1 

2 

3 

4 

5 

6 

7 

167a* 

PCP  ("angel 
dust")  1 

2 

3 

4 

5 

6 

7 

166 

LSD 

("acid,"  "trips")  1 

2 

3 

4 

5 

6 

7 

167b 

OTHER  PSYCHEDELICS 
psilocybin, 
mescaline,  peyote, 
"dmt,"  "stp"  1 

2 

3 

4 

5 

6 

7 

172 

COCAINE  1 

2 

3 

4 

5 

6 

7 

173 

HEROIN 

("smack,"  "horse," 

"skag")  1 

2 

3 

4 

5 

6 

7 

How  often  have  you  ever  used 

each  of  the  following 

drugs  without  a doctor  telling 

you  to  take  them?  Circle  one  answer  for 

each  drug. 

168 

"UPS"  - AMPHETAMINES 
("speed,"  "pep 
pills,"  "diet  pills," 
"bennies,"  "dexies") 
Dexedrine,  Benzedrine, 
Dexamyl  1 

2 

3 

4 

5 

6 

7 

169 

QUAALUDES 
("quads,"  "sopors") 
methaqualone  1 

2 

3 

4 

5 

6 

7 
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Never  ^-9  10-39  40-59  60-99  100-999 

used  times  times  times  times  times 


170  "DOWNS" 

BARBITURATES 
("goofballs,"  "blues," 
"yellows,"  "reds") 

Seconal,  Nembutal, 

T uinal , 

phenobarbital  1 2 

171  TRANQUILIZERS 
Equanil,  Miltown, 

Librium,  Valium, 

Thorazine  1 2 

174  OTHER  NARCOTICS, 

OPIATES 
opium,  morphine 
dolophine,  metha- 
done, Demerol, 

Darvon  1 2 


3 


3 


3 


4 5 


4 5 


4 5 


6 


6 


6 


115  When  you  use  marijuana  or  hashish  how  high  do  you  usually  get?  Circle 
one  answer. 


1 . Not  at  all  high 

2.  A little  high 

3.  Moderately  high 

4.  Very  high 

5.  Do  not  now  use  marijuana 


116  When  you  use  marijuana  or  hashish  how  long  do  you  usually  stay  high? 
Circle  one  answer. 

1.  Usually  don't  get  high 

2.  One  to  2 hours 

3.  Three  to  6 hours 

4.  Seven  to  24  hours 

5.  More  than  24  hours 

6.  Do  not  now  use  marijuana 


1 ,000  or 
more  times 


7 


7 
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In  the  subsections  that  follow,  each  of  the  12  life  domains  list  a series  of  items  that 
should  be  considered  for  inclusion.  Items  denoted  with  an  asterisk  are  of  primary  importance. 
The  items  are  numbered  to  correspond  to  those  in  chapter  1.  In  chapter  4,  entitled  "Short 
Form  Drug  Questionnaire,"  we  have  compiled  a brief  set  of  essential  items  covering  our  primary 
areas  of  interest  for  a general  inquiry  into  potential  consequences  of  marijuana  use.  In  the 
short  form,  we  have  renumbered  the  items  to  facilitate  using  this  form  as  is,  and  have  in- 
serted the  appropriate  skip  patterns  where  necessary.  We  have  also  made  a few  minor  word 
changes. 


PSYCHOSOCIAL  ASPECTS  OF  DRUG  USE 

Circle  the  number  for  "yes"  and  "no"  to  indicate  your  answer  to  each  of  the  following  questions 
Circle  one  number  for  each  question. 

1 2 

YES  NO 


270*  Do  you  think  you  would  find  it  hard  to  get  through 

an  entire  week  without  smoking  some  marijuana?  1 2 

273*  Do  you  feel  that  marijuana  can  be  used  in  approximately 

almost  any  context--for  example,  at  work,  at  home,  or 

out  socially--by  an  experienced  user?  1 2 

274*  Do  you  feel  that  being  a regular  and  experienced 

user  of  marijuana  is  an  important  thing  you  have 

in  common  with  most  of  your  friends?  1 2 

272*  Do  you  find  that  much  of  your  social  life  takes 

place  while  you  have  been  smoking  marijuana?  1 2 

271*  Have  you  made  arrangements  for  assuring 

yourself  a regular  consistent  supply  of  marijuana?  1 2 

269  Do  you  find  smoking  marijuana  in  the  morning 

makes  it  easier  to  start  the  day?  1 2 

ADVERSE  REACTIONS  TO  MARIJUANA 


How 

year 

often  have  the  following  things  happened 
? Circle  one  number  for  each  item  below. 

to  you  as  a 

result  of 

using 

marijuana 

Never 

Only  Once 

momentarily 

2-3 

times 

4-10 

times 

More 
than  10 

55* 

1 was  afraid  of  losing  control 

0 

1 

2 

3 

4 

5 

54* 

1 felt  panicky  because  of 
changes  in  my  sense  of  time 

0 

1 

2 

3 

4 

5 

56* 

The  same  unpleasant  things 
kept  happening  over  and 
over,  and  there  was  nothing 
1 could  do  about  it. 

0 

1 

2 

3 

4 

5 

51* 

1 was  worried  because  1 
didn't  know  how  people 
were  reacting  to  me. 

0 

1 

2 

3 

4 

5 
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Never  Only  Once  2-3  4-10  More 

momentarily times  times  than  10 


53  I felt  everyone  was  making 

fun  of  me  and  laughing  at 


me 

0 

1 

2 

3 

4 

5 

58 

1 had  frightening  or 
terrifying  hallucinations 

0 

1 

2 

3 

4 

5 

57 

1 saw  myself  as  1 really  am 
and  didn't  like  what  1 saw 

0 

1 

2 

3 

4 

5 

PSYCHOLOGICAL  HEALTH 

Below  is  a list  of  problems  and  complaints  that  people  sometimes  have.  Read  each  one  carefully 
INDICATE  HOW  MUCH  THAT  PROBLEM  HAS  BOTHERED  OR  DISTRESSED  YOU  DURING  THE 
PAST  30  DAYS  INCLUDING  TODAY.  Circle  one  answer  for  each  problem.  Use  the  following 
scale: 


Not  at 
all 

A little 
bit 

Moder- 

ately 

Quite 
a bit 

Ex- 

tremely 

375* 

HOW  MUCH  WERE  YOU 
BOTHERED  BY: 

Feeling  blue 

1 

2 

3 

4 

5 

370* 

Feeling  others  are  to 
blame  for  most  of 
your  troubles 

1 

2 

3 

4 

5 

371* 

Thoughts  of  ending 
your  life 

1 

2 

3 

4 

5 

382* 

Having  urges  to  beat, 
injure,  or  harm 
someone 

1 

2 

3 

4 

5 

378* 

Difficulty  making 
decisions 

1 

2 , 

3 

4 

5 

368* 

Nervousness  or  shakiness 
inside 

1 

2 

3 

4 

5 

376 

Feeling  that  people  are 
unfriendly  or  dislike 
you 

1 

2 

3 

4 

5 

383 

Having  urges  to  break 
or  smash  things 

1 

2 

3 

4 

5 

379 

Feeling  hopeless  about 
the  future 

1 

2 

3 

4 

5 

374 

Temper  outbursts  that 
you  could  not  control 

1 

2 

3 

4 

5 
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396  Have  you  ever  felt  that  you  were  going  to  have  or  were  close 

to  having  a nervous  breakdown? 

1.  ( ) YES  --  during  the  past  year  and  I still  feel  near  one 

2.  ( ) YES  --  during  the  past  year  but  I ^ not  feel  near  one  now 

3.  ( ) YES  --  more  than  a year  ago,  and  I am  not  completely  over 

it  yet 

4.  ( ) YES  --  more  than  a year  ago,  but  I am  completely  over  it  now 

5.  ( ) NO  --  never 


SES  AND  ECONOMICS 

204*  What  is  (was)  the  last  year  in  school  you  completed?  Circle  one  grade. 

None 

Elementary  (1,  2,  3,  4,  5,  6,  7,  8) 

High  School  (9,  10,  11,  12) 

Undergraduate  college  (1,  2,  3,  4+) 

Postgraduate  (5  or  more)  (Specify  highest  degree: ) 

What  is  your  occupation?  (What  kind  of  work  do  you  do?  In  what  kind 
of  industry  is  that?) 

207  

(occupational  title  or  duties) 

208  ^ 

(business'  or  industry) 

205*  Are  you  employed  now?  Circle  one  number, 

1 . Yes 

2.  No 

206*  When  you  work,  how  many  hours  a week  do  you  usually  work? 

hou  rs 

217  How  satisfied  are  you  with  the  job  you  now  hold? 

1.  Completely  satisfied 

2.  Quite  satisfied 

3.  Ambivalent,  neither  satisfied  nor  dissatisfied 

4.  Quite  dissatisfied 

5.  Completely  dissatisfied 

213  During  the  past  2 years,  have  you  changed  employers  because  you  got  fired 

1.  No  2.  Yes  Number  of  times 

220  How  important  is  religion  in  your  life?  (Circle  one  answer.) 

1.  Not  important 

2.  A little  important 

3.  Pretty  important 

4.  Very  important 
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DEVIANCE 


49* 

42* 

38* 

50 

37 

41 

8* 

9* 

1* 

10 

3 

107* 


During  the  last  12  months  how  often  have  you  done  the  following  things? 
Circle  one  answer  for  each  item. 

None  One  Two  Three  Five 

or  four  or  more 


During  the  last  12  months,  how  often  have  you: 

Sold  marijuana  12  3 4 

Gotten  into  trouble  with  police 

because  of  something  you  did  12  3 4 


Taken  something  from  a store 

without  paying  for  it  12  3 4 

Sold  other  drugs,  like  heroin 

or  cocaine  12  3 4 


Taken  something  not  belonging 

to  you  worth  over  $50  1 2 3 4 

Damaged  property  at  work  or 

at  school  on  purpose  12  3 4 


ACCIDENTS  AND  HOSPITALIZATION 


5 

5 

5 

5 

5 

5 


How  many  times  have  the  following  things  happened  to  you  in  the  last 
12  months?  Circle  one  answer  for  each  question.  Use  this  scale. 


None  One  Two  Three  Four  Five  Six  or  More 


Had  an  accident  after  drinking  0 12  3 4 

alcohol 

Had  an  accident  after  smoking  0 12  3 4 

marijuana 

Had  an  accident  while  driving  0 1 2 3 4 

a car 


5 

5 

5 


6+ 


6+ 


6+ 


Had  an  accident  after  getting  0 12  3 4 

high  on  some  other  drug 

Had  to  see  a doctor  for  a 0 12  3 4 

health  emergency 


5 

5 


6+ 


6+ 


PHYSICAL  HEALTH 


Were  there  any  days  during  the  past  30  days  when  you  stayed  in  bed 
most  or  aM  of  the  day  because  you  weren't  feeling  well? 

Yes  (answer  A)  No 

A.  About  how  many  days  did  that  happen?  

(No.  of  days) 
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100* 


81* 

70* 

82* 

71 

62 

75 


86a 

86b 


66 

67 

68 
69 


63 


Indicate  if  the  following  statement  is  true  or  false  for  you: 

Definitely  Mostly  Don'^  Mostly  Definitely 
false  false  know  true  true 


I seem  to  get  sick  a little  1 2 3 4 5 

easier  than  other  people 

Indicate  whether  the  following  things  have  happened  to  you  in 
the  last  30  days.  Circle  one  number  for  each  answer. 

Not  at  all  Some  A lot 


In  the  last  30  days,  have  you: 

Had  any  difficulty  in  thinking,  con- 
centrating, or  with  your  memory  1 

Had  any  trouble  with  your  heart  such 
as  racing,  beating,  hard  chest  pains  1 

Had  unusual  trouble  falling  asleep 
at  night  1 

Had  shortness  of  breath  when  you 
were  not  exercising  or  breathing  hard  1 

Had  any  problems  with  your  teeth, 
mouth,  or  gums  1 

Had  any  urinary  problems  (going  to 
the  bathroom)  such  as  difficulty  in 
starting  urine,  burning  feeling,  or 
excessive  frequency  1 

Have  you  ever  had  a miscarriage  _ 

If  yes,  how  many  1 2 


Yes 

3 or  more 


3 

No 


Indicate  whether  the  following  things  have  happened  to  you  in  the  last 
30  days.  Circle  one  number  for  each  answer. 


Not  at  all  Some 


A lot 


In  the  last  30  days,  have  you: 

Had  any  trouble  with  your  lungs  or  breathing, 
for  example: 

a.  Wheezes  or  gasps  12  3 

b.  Coughing  spells  12  3 

c.  Been  coughing  up  phlegm,  blood  12  3 

d.  Chest  colds  more  than  once 

a month  123 

Had  headaches  more  than  once  a week 

(headaches  that  intefere  with  your  12  3 

work  or  with  school  or  ordinary  daily 

activities)? 
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LEISURE  TIME 


On  the  average  during  the  last  12  months,  about  how  many  hours  per  day 
did  you  watch  television? 


31*  hours  per  day 


How  often  do  you  do  the  following? 

Circle  one 

number  for  each. 

Never 

A few 
times  a 
year 

Once  or 
twice 
a month 

At  least 
once  a 
week 

Almost 

every 

day 

How  often  do  you : 

P 

23* 

Participate  in  team  sports 

1 

2 

3 

4 

5 

30* 

Go  to  parties  or  other  social 
affairs 

1 

2 

3 

4 

5 

28* 

Read  books,  magazines,  or 
newspapers 

1 

2 

3 

4 

5 

29 

Go  to  taverns,  bars,  or 
nightclubs 

1 

2 

3 

4 

5 

24 

Go  jogging  or  exercise 
by  yourself 

1 

2 

3 

4 

5 

22 

Ride  around  in  a car 

(or  motorcycle)  just  for  fun 

1 

2 

3 

4 

5 

During  a typical  week,  how  many  evenings  do 
recreation?  (Circle  one  answer) 

you  go  out 

for  fun 

and 

14 

1 . Less  than  one 

2.  One 

3.  Two 

4.  Three 

5.  Four  or  five 

6.  Six  or  seven 

Please  show  whether  you  agree  or  d 
(Circle  one  number.) 

isagree  with  the  statement. 

Disagree 

Mostly 

Disagree 

Neither 

Mostly 

Agree 

Agree 

16. 

1 find  that  1 don't  know 
what  to  do  with  a lot  of 
my  leisure  time 

1 

2 

3 

4 

5 
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INTERPERSONAL  RELATIONS 


221*  At  present,  are  you:  (Circle  one.) 

a)  Married  and  living  with  your  wife/husband 

b)  Living  as  a partner  with  someone  to  whom  you  are  not  married 

c)  Living  at  home  with  your  family  (parent(s),  siblings) 

d)  Living  with  a roomate  of  the  same  sex 
c)  Living  alone 

222*  How  many  times  have  you  been  married?  (Circle  one  answer) 

0 1 2 or  more 

265*  About  how  many  close  friends  do  you  have--people  you  can  feel  at 

ease  with  and  can  talk  to  <a bout  what's  on  your  mind?  (You  may 
include  relatives). 

close  friends 

268*  How  often  do  you  find  yourself  feeling  either  annoyed  or  angry  with 

other  people? 

a.  Very  often 

b.  Fairly  Often 

c.  Occasionally 

d.  Seldom 

e.  Never 

241  Do  you  have  any  children?  Yes If  yes,  how  many 

No 

242  All  things  considered,  how  satisfied  have  you  been  with  your  experience 
of  being  a parent? 

a)  Am  not  a parent 

b)  Completely  dissatisfied 

c)  Quite  dissatisfied 

d)  Somewhat  dissatisfied 

e)  Neither  or  mixed  feelings 

f)  Somewhat  satisfied 

g)  Quite  satisfied 

h)  Completely  satisfied 

266  Which  of  the  following  best  describes  the  way  you  usually  feel  in  a 

social  situation? 


a. 

Always 

uneasy 

b. 

Usually 

uneasy 

c. 

Sometimes  uneasy 

d. 

Rarely 

uneasy 

e. 

Never  uneasy 
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267  Thinking  now  of  the  ways  you 

do  you  feel  you  have  a strong 
things  by  yourself? 


a . 

Often 

b. 

Fairly  often 

c . 

Occasionally 

d. 

Seldom 

e . 

Never 

like  to  spend  your  free  time,  how  often 
need  to  get  away  from  people  and  do 


LIFE  SATISFACTION 

Consider  how  things  have  been  going  for  you  during  the  last  30  days. 
Below  is  a list  of  things  that  can  influence  your  happiness  and  satisfaction 
with  life.  Please  read  each  item  and  indicate  how  you  have  felt  about  it 
over  the  last  30  days.  Indicate  whether  you  have  felt  terrible,  unhappy, 
mostly  dissatisfied,  mixed,  mostly  satisfied,  pleased,  delighted.  Circle 
one  answer  for  each. 


Terrible  Unhappy  Mostly  Mixed  Mostly  Pleased  Delighted 
dis-  satisfied 

satisfied 


Over  the  last  30  days 
how  have  you  felt  about 

284* 

Your  overall  health 

278* 

Your  overall  satisfac- 
tion with  your  work 
(including  being  a 
student  or  housewife) 

288* 

What  you  are  accom- 
plishing with  your  life 

293* 

Your  ability  to 
handle  your  emotions 
and  feelings 

292 

The  fullness  and  com- 
pleteness of  your 
love/sex  life 

317 

Your  prospect  for 
a good  life  in  the 
future 

310 

Your  ability  to  adjust 
to  changes  that  come 
along 

298 

Your  general  enjoy- 
ment of  life 

318 

Your  success  in  getting 
ahead  in  the  world 

3 4 5 6 7 

3 4 5 6 7 


3 4 5 6 7 

3 4 5 6 7 

3 4 5 6 7 


3 4 5 6 7 

3 4 5 6 7 


3 4 5 6 7 

3 4 5 6 7 
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Think  about  how  you  feel  about  your  life  in  general.  Look  at  the  boxes  and  des- 
cription below  and  consider  which  descriptions  fit  best  according  to  how  your  life 
was  2 year  ago  (last  year),  how  it  is  now,  and  what  you  expect  your  life  to  be 
like  2 year  from  now  (next  year). 

Considering  your  life  as  a whole,  rate  yourself  on: 

364.  How  thing  were  this  time  a year  ago.  Check  one  box  only  under  Last  Year. 

365.  How  things  are  (going)  at  present.  Check  one  box  only  under  Now. 


How 

you 

think 

your  life 

situation 

will  most  likely  be  this  time  a year  from 

now. 

Check 

one 

box 

only  under 

Next  Year. 

LAST 

NEXT 

YEAR 

NOW 

YEAR 

[ 

] 

10 

[ 

] 

10 

[ 

] 

10 

. Absolutely  tops,  could  not  be  better 

[ 

] 

9 

[ 

] 

9 

[ 

] 

9 

. Very  good,  could  hardly  be  better 

[ 

] 

8 

[ 

] 

8 

[ 

] 

8 

. Actually  quite  good 

[ 

] 

7 

[ 

] 

7 

[ 

] 

7 

. Pretty  good 

[ 

] 

6 

[ 

] 

6 

[ 

] 

6 

. Somewhat  good  (good  aspects  slightly 
outweigh  the  bad) 

[ 

] 

5 

[ 

] 

5 

[ 

] 

5 

. Good  and  bad  aspects  about  even 

[ 

] 

4 

[ 

] 

4 

[ 

] 

4 

. Somewhat  bad  (bad  aspects  slightly 
outweigh  the  good) 

[ 

] 

3 

[ 

] 

3 

[ 

] 

3 

. Pretty  bad 

[ 

] 

2 

[ 

] 

2 

[ 

] 

2 

. Actually  quite  bad 

[ 

] 

1 

[ 

] 

1 

[ 

] 

1 

. Very  bad,  could  hardly  be  worse 

[ 

] 

0 

[ 

] 

0 

[ 

] 

0 

. Absolute  bottom--could  not  be  worse 

SHORT-  AND  LONG-TERM  DRUG  EFFECTS 

For  the  items  in  these  two  sections,  we  have  simplified  the  format  and  complexity 
of  the  items.  The  interested  reader  is  advised  to  examine  the  original  items  as  pre- 
sented in  chapter  1.  For  our  general  purposes  we  opted  to  focus  only  on  marijuana 
use. 


SHORT-TERM  OR  IMMEDIATE  DRUG  EFFECTS 

Sometimes  the  effects  your  experience  when  you  take  drugs  are  the  ones  you  want; 
sometimes  they  are  not.  Sometimes  drugs  improve  things  for  you;  sometimes  they 
make  matters  worse.  This  section  asks  about  the  short-term  effects  you  get  just 
after  you  take  marijuana. 

The  short-term  effect  of  marijuana  on  your:  (Check  one  answer  for  each  question.) 


Usually  made 
better 

Usually  made 
worse 

Sometimes 

better; 

sometimes 

worse 

Usually 
no  effect 

411* 

Ability  to 
think  clearly 

□ 

□ 

□ 

□ 

412* 

Excitement  and 
enthusiasm  for 

□ 

life 

□ 

□ 

□ 
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Usually  made 
better 

Usually  made 
worse 

Sometimes 

better; 

sometimes 

worse 

Usually 
no  effect 

397* 

Ability  to  relax  □ 

and  enjoy  life 

□ 

□ 

□ 

403* 

Enjoyment  of  □ 

sex 

□ 

□ 

□ 

414* 

Ability  to  avoid  □ 

feeling  angry 

□ 

□ 

□ 

421 

Work  performance  □ 
(including  school 
and  housework) 

□ 

□ 

□ 

423 

Ability  to  cope  and  □ 
solve  life's  problems 

□ 

□ 

□ 

401 

Ability  to  have  a □ 

good  time  with 
friends 

□ 

□ 

□ 

434 

General  satisfaction  □ 
with  life 

□ 

□ 

□ 

407 

General  self-  □ 

confidence 

□ 

□ 

□ 

LONG-TERM  EFFECTS 


Using  marijuana  sometimes  leads  to  changes  in  people's  lives.  For  each  question 
below,  check  whether  you  think  marijuana  has  improved , impaired  or  had  no  effect  on 
your  life.  What  we  are  asking  about  here  is  long-term  effects,  not  the  effects  you 
experience  just  after  taking  the  drug. 

Long-term  effect  of  marijuana  on  your; 


440* 

435* 

436* 

450* 

439* 

442* 


Improved 


Impaired  No  effect 


Ability  to  cope  and  solve 

□ 

□ 

life's  problems 

Physical  health 

□ 

□ 

General  self-confidence 

□ 

□ 

□ 

□ 

□ 


Ability  to  concentrate  on  □ □ □ 

complex  tasks 

Work  performance  □ □ □ 

(including  school  and 

housework) 

Relations  with  employers  or  □ □ □ 

teachers 
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Improved 


Impaired  No  effect 


461* 

Ability  to  think  clearly 

□ 

□ 

□ 

460* 

Memory 

□ 

□ 

□ 

445* 

General  level  of  energy 

□ 

□ 

□ 

455 

Ability  to  enjoy  life 

□ 

□ 

□ 

463 

Ability  to  avoid  shyness  and 
feel  at  ease  with  other  people 

□ 

□ 

□ 

473 

General  satisfaction  with  life 

□ 

□ 

□ 

449 

Relations  with  your  spouse 
or  sex  partner(s) 

□ 

□ 

□ 

448 

Relations  with  close  friends 

□ 

□ 

□ 

466 

Excitement  and  enthusiasm 
for  life 

□ 

□ 

□ 

468 

Ability  to  overcome  worry 
and  anxiety 

□ 

□ 

□ 
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Chapter  4 

DRUG  USE  QUESTIONNAIRE  SHORT  FORM 
DAN  J.  LETTIERI,  PH.D. 
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I 


1 


I,, 


;'h 

111 


ll 


1.  Are  you  (check  one) 

Male 

Female 

2.  How  old  are  you? 

years 

3.  Are  you  (check  one) 

White 

Black 

Asian 

Indian  (American  or  Alaskan) 

Other 

4.  Are  you  of  Hispanic  or  Spanish  origins  (check  one) 

No 

Yes,  Mexican 

Yes,  Puerto  Rican 

Yes,  Cuban 

Yes,  other  Hispanic  or  Spanish 

How  often  have  you  ever  used  each  of  these  substances?  Circle  one  answer  for 
each . 


Never 

1-9 

10-39 

40-59 

60-99 

100-999 

1000  or 

used 

times 

times 

times 

times 

times 

more  times 

5. 

Alcohol 

1 

2 

3 

4 

5 

6 

7 

(beer,  wine,  liquor) 

6. 

Cigarettes 

1 

2 

3 

4 

5 

6 

7 

7. 

PCP 

1 

2 

3 

4 

5 

6 

7 

8. 

About  how 

many  times  altogether 

(if  any) 

have 

you  ever 

used  marij 

uana  or  hashish? 

Circle  one 

answer. 

1 . 

Never  used 

2. 

1 - 

9 times 

3. 

10  - 

39  times 

4. 

40  - 

59  times 

5. 

60  - 

99  times 

6. 

100 

- 999  times 

7. 

1000 

times  or  more 

If  you  circled  never  used  go  to  question  number  28, 

If  you  circled  any  other  answer,  go  to  the  next  question,  number  9. 
How  old  were  you  when  you  first  tried  marijuana  or  hashish? 
(indicate  age)  years 


9. 


10.  When  was  the  most  recent  time  you  used  marijuana  or  hashish?  Circle  one  answer. 

1.  Today 

2.  Yesterday 

3.  Three  to  7 days  ago 

4.  Two  to  4 weeks  ago 

5.  One  to  12  months  ago 

6.  More  than  12  months  ago 

11.  How  often  did  you  use  marijuana  or  hashish  during  the  past  12  months?  Circle 
one  answer. 

1 None 

2 Once  or  twice  during  the  year 

3 Three  to  11  times  during  the  year 

4 Once  a month 

5 Two  or  three  times  a month 

6 Once  a week 

7 Two  or  three  times  a week 

8 Four  to  six  times  a week 

9 Every  day 

12.  How  often  (if  at  all)  have  you  used  marijuana  or  hashish  during  the  last  30  days? 
Circle  one  answer. 


1 . 

None 

2. 

Once  a month 

3. 

Two  or  three  times 

a month 

4. 

Once  a week 

5. 

Two  or  three  days 

a week 

6. 

Four  to  six  days  a 

week 

7. 

Every  day 

13.  During  the  last  30  days  about  how  many  marijuana  cigarettes  (joints,  reefers)  or  the 
equivalent,  did  you  smoke  a day,  on  the  average?  If  you  shared  them  with  other  people, 
count  only  the  amount  you  smoked.  Circle  one  answer. 

1 . None 

2.  Less  than  one  a day 

3.  One  a day 

4.  Two  to  three  a day 

5.  Four  to  six  a day 

6.  Seven  or  more  a day 

14.  Has  there  ever  been  a period  in  your  life  when  you  used  marijuana  or  hashish  on 
a daily,  or  almost  daily,  basis  for  at  least  a month?  Circle  one  answer. 

1 . Yes 

2.  No 

If  you  answered  "no,"  go  to  question  19  and  skip  questions  15,  16,  17,  and  18. 

15.  How  old  were  you  when  you  first  smoked  marijuana  or  hashish  that  frequently,  that 
is,  used  it  daily  or  almost  daily  for  at  least  a month? 

years  old 


age 


16. 


Do  you  still  use  marijuana  or  hashish  on  a daily  or  near  daily  basis?  Circle  one 
answer. 


1.  Yes  If  yes,  go  to  question  18 

2.  No  If  no,  go  to  question  17 

17.  If  you  answered  "no"  to  the  above  question,  how  old  were  you  when  you  last  used 
marijuana  or  hashish  that  frequently? 

years  old 

age 

18.  Altogether,  adding  up  the  different  months  when  you  use  DAILY,  for  about  how 
much  of  your  life  time  would  you  estimate  that  you  have  used  marijuana  and/or 
hashish  daily  or  almost  daily?  Circle  one  answer. 

1 . Less  than  3 months 

2.  Three  to  9 months 

3.  About  1 year 

4.  About  years 

5.  About  2 years 

6.  About  3 to  5 years 

7.  Six  to  9 years 

8.  Ten  or  more  years 

Circle  the  number  for  "yes"  or  "no"  to  indicate  your  answer  to  each  of  the  following 


questions.  Circle  one  number  for  each  question. 

1 2 
YES  NO 


19.  Do  you  think  you  would  find  it  hard  to  get  through 

an  entire  week  without  smoking  some  marijuana?  1 2 

20.  Do  you  feel  that  marijuana  can  be  used  in  almost  any 

context--for  example,  at  work,  at  home,  or  out  1 2 

socially-by  an  experienced  user? 

21.  Do  you  feel  that  being  a regular  and  experienced  user 

of  marijuana  is  an  important  thing  you  have  in  common  1 2 

with  most  of  your  friends? 

22.  Do  you  find  that  much  of  your  social  life  takes  place 

while  you  have  been  smoking  marijuana?  1 2 

23.  Have  you  made  arrangements  for  assuring  yourself 

a regular  consistent  supply  of  marijuana?  1 2 


How  often  have  the  following  things  happened  to  you  as  a result  of  using  marijuana 
in  the  past  year?  Circle  one  number  for  each  item  below. 


Never 

Only  Once 

momentarily 

2-3 

times 

4-5 

times 

More 
than  10 

24. 

1 was  afraid  of  losing  control 

1 

2 

3 

4 

5 

6 

25. 

1 felt  panicky  because  of 
changes  in  my  sense  of  time 

1 

2 

3 

4 

5 

6 

Never  Only  Once  2-3  4-5  More 

momentarily times  times  than  10 


26. 


27. 


28. 

29. 

30. 

31 . 

32. 

33. 

34. 


35. 


36. 


The  same  unpleasant  things  kept 

happening  over  and  over,  and  1 2 3 4 5 6 

there  was  nothing  I could  do 
about  it. 

I was  worried  because  I didn't 

know  how  people  were  reacting  1 2 3 4 5 6 

to  me. 


Below  is  a list  of  problems  and  complaints  that  people  sometimes  have.  Read  each 
one  carefully.  INDICATE  HOW  MUCH  THAT  PROBLEM  HAS  BOTHERED  OR  DIS- 
TRESSED YOU  DURING  THE  PAST  30  DAYS  INCLUDING  TODAY.  Circle  one  answer 
for  each  problem.  Use  the  following  scale: 

Not  at  A little  Moder-  Quite  a Ex- 
all bjt ately b]t tremely 


HOW  MUCH  WERE  YOU 
BOTHERED  BY: 


Feeling  blue  1 2 

Feeling  others  are  to  blame  1 2 

for  most  of  your  troubles 

Thoughts  of  ending  your  life  1 2 


3 

3 

3 


4 

4 

4 


5 

5 

5 


Having  urges  to  beat,  injure,  1 2 3 4 5 

or  harm  someone 


Difficulty  making  decisions 


2 


3 4 5 


Nervousness  or  shakiness  1 2 3 4 5 

inside 


What  is  (was)  the  last  year  in  school  you  completed?  Circle  one  grade. 

NONE 

ELEMENTARY  12345678 
High  school  9 10  11  12 

Undergraduate  college  1 2 3 4+ 

Postgraduate  (5  or  more)  (specify  highest  degree:  ) 

Are  you  employed  now?  Circle  one  number. 

1 . Yes 

2.  No. 


When  you  work,  how  many  hours  a week  do  you  usually  work? 


Hours 


During  the  last  12  months  how  often  have  you  done  the  following  things?  Circle 
one  answer  for  each  item. 


None 

One 

T wo 

Three 
or  four 

Five 
or  more 

During  the  last  12  months,  how 

often 

have  you 

• 

37. 

Sold  marijuana 

1 

2 

3 

4 

5 

38. 

Gotten  into  trouble  with  police 
because  of  something  you  did 

1 

2 

3 

4 

5 

39. 

Taken  something  from  a store 
without  paying  for  it 

1 

2 

3 

4 

5 

How  many  times  have  the  following  things  happened 

to  you  in  the 

last  12  months? 

Circle  one  answer  for  each  question. 

Use  this 

scale: 

None 

one 

two 

three  four 

five  six 

or  more 

40. 

Had  an  accident  after  drinking 
alcohol? 

0 

1 

2 

3 

4 

5 

6+ 

41  . 

Had  an  accident  after  smoking 
marijuana? 

0 

1 

2 

3 

4 

5 

6+ 

42. 

Had  an  accident  while  driving 
a car? 

0 

1 

2 

3 

4 

5 

6+ 

43. 

Were  there  any  days  during  the 
of  the  day  because  you  weren't 

past  30  days  when 
feeling  well? 

you 

stayed  in 

bed  most 

or  ^ 

Yes 

No  (If 

"no, ' 

' go 

to  question  45) 

44.  About  how  many  days  did  that  happen?  

(No.  of  days) 

Indicate  if  the  following  statement  is  true  or  false  for  you: 

Definitely  Mostly  Don't  Mostly  Definitely 

false  false  know  true  true 


45.  I seem  to  get  sick  a little 

easier  than  other  people  1 2 3 4 5 

Indicate  whether  the  following  things  have  happened  to  you  in  the  last  30  days. 
Circle  one  number  for  each  answer. 

Not  at  all  Some A lot 

46.  Had  any  difficulty  in  thinking,  con- 
centrating, or  with  your  memory?  12  3 

47.  Had  any  trouble  with  your  heart  such  as 

racing,  beating,  hard  chest  pains?  12  3 

48.  Had  unusual  trouble  falling  asleep 
at  night? 


1 


2 


3 


49.  On  the  average,  during  the  last  12  months,  about  how  many  hours  per  day  did 
you  watch  television? 

hours  per  day 

How  often  do  you  do  the  following?  Circle  one  number  for  each. 

A few  Once  or  At  least  Almost 
Never  times  a twice  once  a every 
year  a month  week  day 


50.  Participate  in  team  sports  1 2 3 4 5 

51 . Go  to  parties  or  other  social  1 2 3 4 5 

affairs 

52.  Read  books,  magazines,  or  1 2 3 4 5 

newspapers 

53.  At  present,  are  you:  (Circle  one.) 

a)  Married  and  living  with  your  wife/husband 

b)  Living  as  a partner  with  someone  to  whom  you  are  not  married 

c)  Living  at  home  with  your  family  (parent(s),  siblings) 

d)  Living  with  a roomate  of  the  same  sex 

e)  Living  alone 

54.  How  many  times  have  you  been  married?  (Circle  one  answer.) 

0 1 2 or  more 

55.  About  how  many  close  friends  do  you  have  --  people  you  can  feel  at  ease  with 
and  can  talk  to  about  what's  on  your  mind?  (You  may  include  relatives). 

close  friends 

56.  How  often  do  you  find  yourself  feeling  either  annoyed  or  angry  with  other  people? 


a.  Very  often 

b.  Fairly  Often 

c.  Occasionally 

d.  Seldom 

e.  Never 


Consider  how  things  have  been  going  for  you  during  the  last  30  days.  Below  is 
a list  of  things  that  can  influence  your  happiness  and  satisfaction  with  life.  Please 
read  each  itenrrjndicate  how  you  have  felt  about  it  over  the  last  30  days.  Indicate 
whether  you  have  felt  terrible,  unhappy,  mostly  dissatisfied,  mixed,  mostly  satisfied, 
pleased,  delighted.  Circle  one  answer  for  each. 

Terrible  Unhappy  Mostly  Mixed  Mostly  Pleased  Delighted 
dis-  satisfied 

satisfied 


Over  the  last  30  days, 
how  have  you  felt  about: 


57. 

Your  overall  health 

1 

2 

3 

4 

5 

6 7 

58. 

Your  overall  satisfaction  1 

with  your  work  (including 
being  a student  or  housewife) 

2 

3 

4 

5 

6 7 

59. 

What  you  are  accomplishing 
with  your  life 

1 

2 

3 

4 

5 

6 7 

60. 

Your  ability  to  handle  your 
emotions  and  feelings 

1 

2 

3 

4 

5 

6 7 

If  you've  never  used  marijuana,  skip  all  the 
finished  the  questionnaire. 

remail 

ning  items.  You 

have  now 

Sometimes  the  effects  you  experience  when  you  take  drugs  are  the  ones  you  want; 
sometimes  they  are  not.  Sometimes  drugs  improve  things  for  you;  sometimes  they 
make  matters  worse.  This  section  asks  about  the  short-term  effects  you  get  just 

after  you  take  marijuana. 

The  short-term  or  immediate  effect 
each  question.) 

of  marijuana 

on 

your: 

(Check 

one  answer  for 

Usually 

made 

better 

Usually 

made 

worse 

Sometimes 
better;  sometimes 
worse 

Usually 

no 

effect 

61 . 

Ability  to  think  clearly 

□ 

□ 

□ 

□ 

62. 

Excitement  and  enthusiasm 
for  life 

□ 

□ 

□ 

□ 

63. 

Ability  to  relax  and  enjoy 
life 

□ 

□ 

□ 

□ 

64. 

Enjoyment  of  sex 

□ 

□ 

□ 

□ 

65. 

Ability  to  avoid  angry 
feelings 

□ 

□ 

□ 

□ 

Using  marijuana  sometimes  leads  to  changes  in  people's  lives.  For  each  question 
listed  below,  check  whether  you  think  marijuana  has  improved,  impaired , or  had 
no  effect  on  your  life.  What  we  are  asking  about  here  is  long-term  effects,  not 
the  effects  you  experience  just  after  taking  the  drug. 

Long-term  effect  of  marijuana  on  your: 

Improved  Impaired  No  effect 


66. 

Ability  to  cope  and  solve  life's 
problems 

□ 

□ 

□ 

67. 

Physical  health 

□ 

□ 

□ 

68. 

General  self-confidence 

□ 

□ 

□ 

69. 

Ability  to  concentrate  on 
complex  tasks 

□ 

□ 

□ 

70. 

Work  performance  (including 
school  and  housework) 

□ 

□ 

□ 

71 . 

Relations  with  employers  or 
teachers 

□ 

□ 

□ 

72. 

Ability  to  think  clearly 

□ 

□ 

□ 

73. 

Memory 

□ 

□ 

□ 

74. 

General  level  of  energy 

□ 

□ 

□ 
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and  long  term  effects.  Also  included  is  a brief  questionnaire  which  is  recom- 
mended for  future  studies. 

DRUGS  AND  THE  FAMILY.  Recent  and  classic  research  on  the  role  of  the 
family  in  the  drug  use  of  one  or  more  of  its  members.  Divided  into  sections 
dealing  with  research  reviews,  treatment,  family  dynamics,  and  adolescent- 
parent  relationships.  An  introductory  essay  is  included,  and  each  section  is 
preceded  by  a brief  overview.  120  abstracts. 


Volumes  in  the  series  are  available  for  purchase  from  the  Superintendent  of  Documents,  Government  Printing  Office. 
Washington,  D.C.  20402.  When  ordering,  please  give  title  and  stock  number  of  the  publication. 
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